-- Logs begin at Mon 2022-04-11 23:18:07 UTC, end at Tue 2022-04-12 00:51:07 UTC. -- Apr 12 00:10:54.684193 dv-cinder-836252-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 12 00:10:54.691854 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 12 00:10:54.693885 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 12 00:10:54 2022] *** Apr 12 00:10:54.693885 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 12 00:10:54.693885 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 12 00:10:54.693885 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: nodename: dv-cinder-836252-3-iscsi Apr 12 00:10:54.693885 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: machine: x86_64 Apr 12 00:10:54.693885 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: clock source: unix Apr 12 00:10:54.693885 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: pcre jit disabled Apr 12 00:10:54.693885 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: detected number of CPU cores: 4 Apr 12 00:10:54.694409 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: current working directory: / Apr 12 00:10:54.694409 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: detected binary path: /usr/bin/uwsgi-core Apr 12 00:10:54.694409 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: your processes number limit is 47680 Apr 12 00:10:54.694409 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: your memory page size is 4096 bytes Apr 12 00:10:54.694409 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: detected max file descriptor number: 2048 Apr 12 00:10:54.694409 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: lock engine: pthread robust mutexes Apr 12 00:10:54.694409 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: thunder lock: enabled Apr 12 00:10:54.695415 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 12 00:10:54.695415 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 12 00:10:54.740756 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: Python main interpreter initialized at 0x55f1663d89c0 Apr 12 00:10:54.740756 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: python threads support enabled Apr 12 00:10:54.740756 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: your server socket listen backlog is limited to 100 connections Apr 12 00:10:54.740756 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: your mercy for graceful operations on workers is 90 seconds Apr 12 00:10:54.741117 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: mapped 403077 bytes (393 KB) for 2 cores Apr 12 00:10:54.741175 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: *** Operational MODE: preforking *** Apr 12 00:10:54.741471 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: *** uWSGI is running in multiple interpreter mode *** Apr 12 00:10:54.741471 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: spawned uWSGI master process (pid: 86084) Apr 12 00:10:54.741678 dv-cinder-836252-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 12 00:10:54.744669 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: spawned uWSGI worker 1 (pid: 86099, cores: 1) Apr 12 00:10:54.744669 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: spawned uWSGI worker 2 (pid: 86100, cores: 1) Apr 12 00:10:54.744669 dv-cinder-836252-3-iscsi devstack@keystone.service[86084]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 00:11:00.567890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:11:00.567890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: from cryptography.utils import int_from_bytes Apr 12 00:11:00.568653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:11:00.568653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: from cryptography.utils import int_from_bytes Apr 12 00:11:00.568758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:11:00.568758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: from cryptography.utils import int_from_bytes Apr 12 00:11:00.569158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 12 00:11:00.569158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: from cryptography.utils import int_from_bytes Apr 12 00:11:00.619198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 00:11:00.619462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 00:11:00.619604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] command line args: [] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 00:11:00.619761 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 12 00:11:00.619854 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 00:11:00.619989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 12 00:11:00.620072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ================================================================================ {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 00:11:00.620134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] command line args: [] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 12 00:11:00.620275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] admin_token = **** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.620424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 12 00:11:00.620515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] config_dir = [] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.620583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ================================================================================ {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 12 00:11:00.620723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.620806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] admin_token = **** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.620873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] config_source = [] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.621033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] debug = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.621124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] config_dir = [] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.621253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.621332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.623550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] config_source = [] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.623550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] debug = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.623695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.623695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.623801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.623801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.624510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.624579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.624638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.624700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.624759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] list_limit = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.624822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.624887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] log_config_append = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.624887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.624996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] list_limit = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] log_dir = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] log_config_append = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] log_file = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] log_dir = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625403 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] log_file = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.625980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.626047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.626106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.626170 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.626242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.626922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.627159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.627330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.627538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.627763 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.627927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.628151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.628321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.628517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.628707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.628895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.629121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.629317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.629479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.629675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.629675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.630046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.630046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] publish_errors = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.630420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.630643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.630842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] publish_errors = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.631010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.631199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.631386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.631580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.631736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.631905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.632123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.632254 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.632418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] standard_threads = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.632559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.632692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.632824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] standard_threads = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.632950 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.633080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.633245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.633245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] use_journal = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.633488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.633614 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] use_json = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.633743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.633868 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] use_stderr = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.633993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] use_journal = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.634117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] use_syslog = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.634288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] use_json = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.634288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] use_stderr = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.634607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.634745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] use_syslog = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.634878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.635010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 12 00:11:00.635143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.635275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.635405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.635531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.635654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.635784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.635917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.636042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.636183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.636309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.636433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.636634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.636761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.636896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.637021 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.637152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.637277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.637409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.637540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.637671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.637797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.637926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.638061 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.638195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.638343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.638478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.638615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.638739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.638869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.639002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.639128 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.639253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.639378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.639501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.639625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.639767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.639899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.640024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.640155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.640287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.640411 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.640543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.640669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.640793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.640793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.641032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.641157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.641293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.641435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.641562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.641686 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.641810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.641933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.642065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.642191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.642348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.642475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.642599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.642723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.642973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.643113 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.643253 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.643379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.643504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.643628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.643761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.643892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.644018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.644142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.644265 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.644390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.644526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.644658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.644783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.644907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.645040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.645172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.645298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.645423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.645547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.645678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.645809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.645942 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.646068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.646198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.646476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.646606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.646730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.646878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.648082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.648290 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.648454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.648646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.648836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.649061 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.649228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.649416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.649604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.649794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.649989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.650212 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.650418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.650680 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.650882 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.651045 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.651045 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.651413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.651603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.651792 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.651981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.652170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.652365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.652589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.652753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.652945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.653111 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.653280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.653421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.653557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.653721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.653855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.653991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.654118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.654291 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.654468 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.654613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.654754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.654883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.655009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.655146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.655271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.655395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.655532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.655666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.655823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.655954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.656087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.656214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.656347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.656474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.656599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.656730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.656877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.657004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.657139 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.657266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.657391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.657515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.657640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.657773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.657907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.658033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.658164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.658318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.658490 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.658656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.660211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.660397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.660536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.660667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.660795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.660922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.661060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.661189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.661325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.661453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.661580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.661714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.661843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.661969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.662108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.662241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.662447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.662585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.662818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.662949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.663076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.663207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.663336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.663470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.663608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.663746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.663875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.664018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.664146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.664272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.664399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.664533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.664661 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.664787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.664913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.665038 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.665176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.665311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.665704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.665841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.665968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] auth.external = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.666544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] auth.password = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.667577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] auth.token = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.667577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.667577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.667577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.667577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.667577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.667577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.667577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.667577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] credential.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] auth.external = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.669491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] auth.password = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.670505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.670644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] auth.token = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.671262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.671393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.671520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.671652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.671781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.671916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.672313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] federation.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.673363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.673363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.673363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.673363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.673363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.673363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.673363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.673363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.674319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.674452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.674580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.674580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.674836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.674965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] credential.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.675092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.675219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.675345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.675481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.675618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.675745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.675878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.676012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.676140 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.676267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.676472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.676602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.676728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.676917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.677053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.677180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.677325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.677454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.677581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.677707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.677869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.677869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.678133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.678296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.678432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.678559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.678685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.678812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.678949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.679077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.679214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.679341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.679476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] federation.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.679604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.679742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.679870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.679997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.680124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.680250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.680250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.680507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.680507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.680749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.680886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.681012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.681139 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.681274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.681402 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.681528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.681654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.681780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.681914 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.682041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.682168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.682326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.682459 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.682585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.682736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.682865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.682991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.683117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.683244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.683371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.683505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.683633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.683760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.683885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.684011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.684137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.684271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.684399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.684541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.684668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.684795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.684922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.685055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.685182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.685308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.685434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.685560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.685685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.685820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.685947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.686073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.686214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.686373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.687101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.687242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.687378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.687509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.687635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.687769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.687896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.688037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.688169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.688296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.688423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.688550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.688687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.688825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.688953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.689080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.689213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.689341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.689467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.689603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.689731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.689858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.689985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.690111 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.690237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.690417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.690547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.690681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.690808 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.690935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.691062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.691197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.691325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.691462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.691589 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.691717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.691844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.691979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.692108 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.692250 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.692378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.692505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.692631 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.692768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.692896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.693023 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.693148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.693275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.693409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.693545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.693673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.693802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.693928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.694070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.694198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.694363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.694493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.694620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.694748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.694876 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.695002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.695136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.695265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.695392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.695519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.695645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.695782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.695920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.696048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.696175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.696301 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.696428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.696561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.696696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.696825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.696954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.697080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.697207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.697341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.697469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.697606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.697739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.697868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.698005 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.698141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.698369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.698515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.698643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.698770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.698896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.699031 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.699160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] resource.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.699287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.699413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.699549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.699675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.699810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.699939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.700066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.700193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.700319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.700445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.700579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.700707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.700834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.700960 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.701087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.701223 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.701358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.701486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.701612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.701738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] role.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.701863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.701993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] role.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.702216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.702387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.702515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.702642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.702768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.702904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.703041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.703181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.703308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.703435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.703561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.703687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.703822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.703949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.704076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.704203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.704329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.704456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.704590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.704718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.704844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.704980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.705107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.705234 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.705369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.705498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.705625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.705751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.705878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.705878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.706129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.706276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] resource.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.706410 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.706537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.706673 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.706800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.706938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.707066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.707192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.707318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.707453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.707586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.707728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.707863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.708007 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.708140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.708273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.708425 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.708560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.708695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.708828 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.708962 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] role.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.709095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.709235 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] role.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.709370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.709504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.709636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.709769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.709902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.710043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.710178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.710398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.710536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.710670 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.710804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.710948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.711083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.711083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] token.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.711335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.711467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.711600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.711741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.711875 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.712008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.712150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.712283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.712416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.712557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.712692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.712825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.712957 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.713089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.713222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.713363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.713497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.713631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.713631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.713882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.714024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.714166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.714319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.714458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.714592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.714725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.714858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.715001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.715137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.715277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.715412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.715544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.715677 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.715828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.715963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.connection = **** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.716105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.716247 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.716382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.716515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.716647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.716790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.716925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.717057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.717190 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.717323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.717455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.717597 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.717744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.717888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.718023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.718156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.718306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.718456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.718592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.718725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.718859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] token.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.718993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.719126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.719267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.719402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.719534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.719684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.719819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.719953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.720094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.720228 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.720360 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.720493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.720626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.720759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.720901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.720901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 00:11:00.721156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.721156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.721156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.721156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.721156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.721156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.721156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.721156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.721156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.722274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.722274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.connection = **** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.722274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.722274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.722274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.722274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.722274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.722274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.722274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.723488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.723488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.723488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.723488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.723488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.723488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.723488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.723488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.723488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.724578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.724578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 12 00:11:00.724578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86100) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 12 00:11:00.741304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.741535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.741759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.743618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.743856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.744083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.750937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.753283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.779151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.779379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.779946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.780228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.834333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.834794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.884624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.884902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.886097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.886360 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.953264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.953450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.953554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.953643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.953729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.953845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.953940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.954066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.954160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.954309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.954409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.954530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.978811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.979044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.979274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.979497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.979743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.979955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.980173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.980409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.980641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.980862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.981080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.981295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.981508 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.981719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.991645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:00.992108 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.005036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.005239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.005338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.005544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.005772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.005995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.006217 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.006462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.010986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.011231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.011637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.011868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.012097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.012324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86100) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 12 00:11:01.023719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.023931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 00:11:01.024270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.024472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 00:11:01.024741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.025001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.025259 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.025489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.025639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.025770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 00:11:01.026024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.026223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 12 00:11:01.026520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.026783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.027036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.027290 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.037029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.037307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.037578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.037859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.038782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.039065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.039335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.039616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.046755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.048551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.050025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.050442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.050731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.051016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.051300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.051564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.051836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.051968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.052104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.052250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.052396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.052527 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.052669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.052808 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.052951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.053093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.053271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.053540 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.053813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.054083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.054378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.054647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.079217 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.080818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.080958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.081103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.082468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.082748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.086434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.086673 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.086955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.087959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.088238 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.088514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.094755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.095113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.096408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.096689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.099610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.099898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.100181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.100460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.100733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.101004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.101267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.101404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.101559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.101695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.101823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.102086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.102384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.102675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.102927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.103191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.120291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.120568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.121905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.122182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.125667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.127280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.129319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.129612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.130922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.131215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.134646 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.136193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.139850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.141450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.143533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.143837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.144121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.144412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.144693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.144972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.145109 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.145392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.145676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.145958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.146235 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.146533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.268279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.268603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.268850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.269114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.269800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.270104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.270399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.270666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.276998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.278494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.278801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.279078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.280216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.280489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.282112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.282415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.282879 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.283161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.283436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.283592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.283868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.284321 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.284602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.284878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.296959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.297241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.297523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.297802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.298080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.298338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.298426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.298618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.298705 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.298899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.299178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.299455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.299735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.300017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.317284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.318486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.320561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.321720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.323911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.325037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.325505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.326657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.327837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.328117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.328396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.328997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.329274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.329554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.335688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.336826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.337469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.338390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.340716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.341007 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.341305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.341579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.341726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.341860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.342147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.342443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.350928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.351233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.351515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.351663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.351837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.352125 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.359947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.360231 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.360515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.360660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86100) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 12 00:11:01.360793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.360922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.361060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.361192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.361331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.361468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.361599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.361737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.361886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.362114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.362303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.362503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.362638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.362770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.362907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.363066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.363202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.363345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.363486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.363617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.363747 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.363957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.364098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.364098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86100) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 12 00:11:01.401435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f1663d89c0 pid: 86099 (default app) Apr 12 00:11:01.403220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f1663d89c0 pid: 86100 (default app) Apr 12 00:11:01.404916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47458977-ffad-4be0-9033-fd4cb3ce1271 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:01.405291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47458977-ffad-4be0-9033-fd4cb3ce1271 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:01.405576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47458977-ffad-4be0-9033-fd4cb3ce1271 None None] PATH_INFO: `/v3` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:01.409789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Tue Apr 12 00:11:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:09.846515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b70caa-315c-4e4d-9cd3-84929bc8a606 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:09.847030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b70caa-315c-4e4d-9cd3-84929bc8a606 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:09.847131 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b70caa-315c-4e4d-9cd3-84929bc8a606 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:09.851383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:11:09.856516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:09.857029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:09.857119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:09.888326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG oslo_db.sqlalchemy.engines [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:11:10.070825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG passlib.handlers.bcrypt [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86099) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 12 00:11:10.071249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG passlib.handlers.bcrypt [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86099) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 12 00:11:10.127472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:10.129121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:10.251908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 12 00:11:10.405641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b70caa-315c-4e4d-9cd3-84929bc8a606 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:10.438466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG oslo_db.sqlalchemy.engines [None req-29b70caa-315c-4e4d-9cd3-84929bc8a606 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86100) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 12 00:11:10.566817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b70caa-315c-4e4d-9cd3-84929bc8a606 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:10.571120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce641520-e680-4cc1-a9c5-d8c88b403612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:10.571791 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641520-e680-4cc1-a9c5-d8c88b403612 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:10.572080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641520-e680-4cc1-a9c5-d8c88b403612 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:10.572361 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce641520-e680-4cc1-a9c5-d8c88b403612 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:10.581551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641520-e680-4cc1-a9c5-d8c88b403612 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:10.632802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ce641520-e680-4cc1-a9c5-d8c88b403612 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 12 00:11:10.633148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce641520-e680-4cc1-a9c5-d8c88b403612 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:10.643605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Tue Apr 12 00:11:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 00:11:10.651099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:10.666539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86f5bc-f96a-449d-9d61-c29a6d47c967 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:10.671018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5b51a-b0f8-4e75-b592-4a738fb8d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:10.672168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5b51a-b0f8-4e75-b592-4a738fb8d926 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:10.672456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5b51a-b0f8-4e75-b592-4a738fb8d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:10.672733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5b51a-b0f8-4e75-b592-4a738fb8d926 admin admin] PATH_INFO: `/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:10.674307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5b51a-b0f8-4e75-b592-4a738fb8d926 admin admin] RBAC: Authorizing `identity:get_project(project_id=fd9f2f2aa4034c3fa25d211a3bd7ce30)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:10.727831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d7b5b51a-b0f8-4e75-b592-4a738fb8d926 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 12 00:11:10.728188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5b51a-b0f8-4e75-b592-4a738fb8d926 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:10.733266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Tue Apr 12 00:11:10 2022] GET /identity/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:12.981740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52116b00-bd55-46d9-a4a7-bf3f92cdfa3f None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:12.982237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52116b00-bd55-46d9-a4a7-bf3f92cdfa3f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:12.982356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52116b00-bd55-46d9-a4a7-bf3f92cdfa3f None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:12.986935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:12.992230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea538c2-7276-4bde-bed6-b9190c9f22d6 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:12.992668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea538c2-7276-4bde-bed6-b9190c9f22d6 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:12.992799 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea538c2-7276-4bde-bed6-b9190c9f22d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:13.011975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-4ea538c2-7276-4bde-bed6-b9190c9f22d6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:13.013541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4ea538c2-7276-4bde-bed6-b9190c9f22d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:13.021609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 12 00:11:13.043991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52116b00-bd55-46d9-a4a7-bf3f92cdfa3f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:13.056231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52116b00-bd55-46d9-a4a7-bf3f92cdfa3f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:13.060337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83e63a-c4a2-44bd-a1b1-cdd33ab49f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:13.060963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83e63a-c4a2-44bd-a1b1-cdd33ab49f43 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:13.061606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83e63a-c4a2-44bd-a1b1-cdd33ab49f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:13.061886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83e63a-c4a2-44bd-a1b1-cdd33ab49f43 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:13.069723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83e63a-c4a2-44bd-a1b1-cdd33ab49f43 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:13.071498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83e63a-c4a2-44bd-a1b1-cdd33ab49f43 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:13.080064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Tue Apr 12 00:11:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:11:13.086837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea538c2-7276-4bde-bed6-b9190c9f22d6 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:13.096423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea538c2-7276-4bde-bed6-b9190c9f22d6 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:13.100904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cce2cb-ba75-4ccf-a1c4-3074344f26f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:13.101835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cce2cb-ba75-4ccf-a1c4-3074344f26f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:13.102191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cce2cb-ba75-4ccf-a1c4-3074344f26f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:13.102569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cce2cb-ba75-4ccf-a1c4-3074344f26f4 admin admin] PATH_INFO: `/v3/users/674ef23c54a243f3842909c6f536a72a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:13.103976 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cce2cb-ba75-4ccf-a1c4-3074344f26f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=674ef23c54a243f3842909c6f536a72a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:13.105804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cce2cb-ba75-4ccf-a1c4-3074344f26f4 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:13.107401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Tue Apr 12 00:11:13 2022] GET /identity/v3/users/674ef23c54a243f3842909c6f536a72a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:15.442166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484cffd-a646-43d8-b03c-bfd30ddeca40 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:15.442710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484cffd-a646-43d8-b03c-bfd30ddeca40 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:15.442786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484cffd-a646-43d8-b03c-bfd30ddeca40 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:15.444086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:15.449306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ece7d-c478-417c-a006-6a08bfac53ed None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:15.449718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ece7d-c478-417c-a006-6a08bfac53ed None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:15.449884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ece7d-c478-417c-a006-6a08bfac53ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:15.466562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ed8ece7d-c478-417c-a006-6a08bfac53ed None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:15.467731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ed8ece7d-c478-417c-a006-6a08bfac53ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:15.492386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e74654-4547-483c-9519-05e53f1653ff None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:15.492688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e74654-4547-483c-9519-05e53f1653ff None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:15.492949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e74654-4547-483c-9519-05e53f1653ff None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:15.494320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 6/11] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:11:15.499915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e971e-ca37-4e66-865f-9eb48a142d9b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:15.500210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e971e-ca37-4e66-865f-9eb48a142d9b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:15.500491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e971e-ca37-4e66-865f-9eb48a142d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:15.540466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG passlib.handlers.bcrypt [None req-544e971e-ca37-4e66-865f-9eb48a142d9b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86100) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 12 00:11:15.540910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG passlib.handlers.bcrypt [None req-544e971e-ca37-4e66-865f-9eb48a142d9b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86100) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 12 00:11:15.545439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 6/12] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:11:15.569364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ece7d-c478-417c-a006-6a08bfac53ed None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:15.588636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-544e971e-ca37-4e66-865f-9eb48a142d9b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:15.590274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-544e971e-ca37-4e66-865f-9eb48a142d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:15.669433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ece7d-c478-417c-a006-6a08bfac53ed None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:15.689393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 7/13] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:11:15.702790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270d7b-1f7a-47e1-9cc0-842a2c4128ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:15.703534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270d7b-1f7a-47e1-9cc0-842a2c4128ad None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:15.703820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270d7b-1f7a-47e1-9cc0-842a2c4128ad None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:15.704099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270d7b-1f7a-47e1-9cc0-842a2c4128ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:15.711119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e971e-ca37-4e66-865f-9eb48a142d9b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:15.715287 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba270d7b-1f7a-47e1-9cc0-842a2c4128ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:15.722204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-ba270d7b-1f7a-47e1-9cc0-842a2c4128ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:11:15.723800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 7/14] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:11:15.729065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270d7b-1f7a-47e1-9cc0-842a2c4128ad None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:15.807826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e971e-ca37-4e66-865f-9eb48a142d9b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:15.823866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270d7b-1f7a-47e1-9cc0-842a2c4128ad None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:15.841839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0db7f-238f-4a42-973e-79eab942c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:15.843373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0db7f-238f-4a42-973e-79eab942c756 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:15.843660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0db7f-238f-4a42-973e-79eab942c756 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:15.843938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0db7f-238f-4a42-973e-79eab942c756 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:15.856328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438fb3b-aeca-4aa9-8f1b-a6678ef55c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:15.856989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438fb3b-aeca-4aa9-8f1b-a6678ef55c21 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:15.857269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438fb3b-aeca-4aa9-8f1b-a6678ef55c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:15.857543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438fb3b-aeca-4aa9-8f1b-a6678ef55c21 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:15.858933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438fb3b-aeca-4aa9-8f1b-a6678ef55c21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:15.859233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438fb3b-aeca-4aa9-8f1b-a6678ef55c21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:15.860678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438fb3b-aeca-4aa9-8f1b-a6678ef55c21 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:15.872329 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 8/15] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:15.879376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438fb3b-aeca-4aa9-8f1b-a6678ef55c21 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:15.911956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0db7f-238f-4a42-973e-79eab942c756 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:15.913478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0db7f-238f-4a42-973e-79eab942c756 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:15.973111 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438fb3b-aeca-4aa9-8f1b-a6678ef55c21 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:16.006577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bf8a5-18af-41cd-a2ad-75275599fa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:16.007456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bf8a5-18af-41cd-a2ad-75275599fa03 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:16.007748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bf8a5-18af-41cd-a2ad-75275599fa03 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:16.008025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bf8a5-18af-41cd-a2ad-75275599fa03 None admin] PATH_INFO: `/v3/users/674ef23c54a243f3842909c6f536a72a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:16.009241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bf8a5-18af-41cd-a2ad-75275599fa03 None admin] RBAC: Authorizing `identity:get_user(user_id=674ef23c54a243f3842909c6f536a72a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:16.015728 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 8/16] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 00:11:16.015877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bf8a5-18af-41cd-a2ad-75275599fa03 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:16.015877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 9/17] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:15 2022] GET /identity/v3/users/674ef23c54a243f3842909c6f536a72a => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:16.017895 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bf8a5-18af-41cd-a2ad-75275599fa03 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:16.018011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0db7f-238f-4a42-973e-79eab942c756 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:16.113994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0db7f-238f-4a42-973e-79eab942c756 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:16.115459 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bf8a5-18af-41cd-a2ad-75275599fa03 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:16.146676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee0a38-f399-4b38-948e-2ee93e984120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:16.147477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0a38-f399-4b38-948e-2ee93e984120 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:16.147769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0a38-f399-4b38-948e-2ee93e984120 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:16.148051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee0a38-f399-4b38-948e-2ee93e984120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:16.149693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ef8a-5272-4f56-be05-752dbf7c3ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:16.150524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ef8a-5272-4f56-be05-752dbf7c3ed0 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:16.150811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ef8a-5272-4f56-be05-752dbf7c3ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:16.151087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ef8a-5272-4f56-be05-752dbf7c3ed0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:16.152269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573ef8a-5272-4f56-be05-752dbf7c3ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:16.153723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573ef8a-5272-4f56-be05-752dbf7c3ed0 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:16.156148 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 10/18] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:16.161678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ef8a-5272-4f56-be05-752dbf7c3ed0 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:16.167283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee0a38-f399-4b38-948e-2ee93e984120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:16.168771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee0a38-f399-4b38-948e-2ee93e984120 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:16.186080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-79ee0a38-f399-4b38-948e-2ee93e984120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:11:16.187493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 9/19] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:16.192940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee0a38-f399-4b38-948e-2ee93e984120 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:16.258717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ef8a-5272-4f56-be05-752dbf7c3ed0 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:16.289180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee0a38-f399-4b38-948e-2ee93e984120 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:16.291658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f53754-58cb-4fb6-b284-bfbf561e0ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:16.292321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f53754-58cb-4fb6-b284-bfbf561e0ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:16.292609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f53754-58cb-4fb6-b284-bfbf561e0ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:16.292889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f53754-58cb-4fb6-b284-bfbf561e0ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:16.293718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f53754-58cb-4fb6-b284-bfbf561e0ff8 None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.domain.id=default, user.id=674ef23c54a243f3842909c6f536a72a) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:16.294033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f53754-58cb-4fb6-b284-bfbf561e0ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:16.296152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f53754-58cb-4fb6-b284-bfbf561e0ff8 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:16.303218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 11/20] 10.222.0.32 () {56 vars in 1322 bytes} [Tue Apr 12 00:11:16 2022] GET /identity/v3/role_assignments?user.id=674ef23c54a243f3842909c6f536a72a&scope.domain.id=default&role.id=f0208c43117c4b799194c83781a46e09 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:16.326462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708f5a5-3dd0-4bef-b47b-5b1a5f9148f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:16.327487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708f5a5-3dd0-4bef-b47b-5b1a5f9148f3 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:16.327977 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708f5a5-3dd0-4bef-b47b-5b1a5f9148f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:16.328439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708f5a5-3dd0-4bef-b47b-5b1a5f9148f3 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:16.329392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708f5a5-3dd0-4bef-b47b-5b1a5f9148f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:16.329888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708f5a5-3dd0-4bef-b47b-5b1a5f9148f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:16.331536 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708f5a5-3dd0-4bef-b47b-5b1a5f9148f3 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:16.351674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 10/21] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:19.119406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00708bc2-a2d8-49c2-b292-44e1f6905afd None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:19.119920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00708bc2-a2d8-49c2-b292-44e1f6905afd None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:19.120020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00708bc2-a2d8-49c2-b292-44e1f6905afd None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:19.121314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 12/22] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:19.136751 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108da38-46d1-4543-801b-f8b9643c4e23 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:19.137215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108da38-46d1-4543-801b-f8b9643c4e23 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:19.137451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108da38-46d1-4543-801b-f8b9643c4e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:19.166765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-9108da38-46d1-4543-801b-f8b9643c4e23 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:19.167971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9108da38-46d1-4543-801b-f8b9643c4e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:19.256893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 11/23] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:11:19.296055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00708bc2-a2d8-49c2-b292-44e1f6905afd None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:19.416313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00708bc2-a2d8-49c2-b292-44e1f6905afd None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:19.454370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ba75e-fbcf-409f-b86e-e928bb4dce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:19.455536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ba75e-fbcf-409f-b86e-e928bb4dce36 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:19.456046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ba75e-fbcf-409f-b86e-e928bb4dce36 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:19.456529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ba75e-fbcf-409f-b86e-e928bb4dce36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:19.471561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ba75e-fbcf-409f-b86e-e928bb4dce36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:19.478878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-8a7ba75e-fbcf-409f-b86e-e928bb4dce36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:11:19.485379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 13/24] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:19.487397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108da38-46d1-4543-801b-f8b9643c4e23 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:19.633429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108da38-46d1-4543-801b-f8b9643c4e23 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:19.678409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0493b27-c41c-47d4-8b09-95cb4378a06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:19.679101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0493b27-c41c-47d4-8b09-95cb4378a06d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:19.679377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0493b27-c41c-47d4-8b09-95cb4378a06d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:19.679659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0493b27-c41c-47d4-8b09-95cb4378a06d None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:19.680416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0493b27-c41c-47d4-8b09-95cb4378a06d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:19.680723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0493b27-c41c-47d4-8b09-95cb4378a06d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:19.682115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0493b27-c41c-47d4-8b09-95cb4378a06d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:19.697861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 12/25] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:19.705482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ba75e-fbcf-409f-b86e-e928bb4dce36 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:19.809898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ba75e-fbcf-409f-b86e-e928bb4dce36 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:19.846052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf14fa4-f41b-4c49-b109-6a3139c75965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:19.846967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf14fa4-f41b-4c49-b109-6a3139c75965 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:19.847251 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf14fa4-f41b-4c49-b109-6a3139c75965 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:19.847523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf14fa4-f41b-4c49-b109-6a3139c75965 None admin] PATH_INFO: `/v3/users/674ef23c54a243f3842909c6f536a72a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:19.855694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb6a5e-3703-4d51-83d5-6abfc4e7fc41 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:19.855987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb6a5e-3703-4d51-83d5-6abfc4e7fc41 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:19.856268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb6a5e-3703-4d51-83d5-6abfc4e7fc41 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:19.857629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 13/26] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:19.858396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf14fa4-f41b-4c49-b109-6a3139c75965 None admin] RBAC: Authorizing `identity:get_user(user_id=674ef23c54a243f3842909c6f536a72a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:19.859881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf14fa4-f41b-4c49-b109-6a3139c75965 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:19.861834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 14/27] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:19 2022] GET /identity/v3/users/674ef23c54a243f3842909c6f536a72a => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:19.866799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb6a5e-3703-4d51-83d5-6abfc4e7fc41 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:19.876785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3c1c-f429-4446-aaf9-f59c40ec06f2 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:19.877062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3c1c-f429-4446-aaf9-f59c40ec06f2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:19.877346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a3c1c-f429-4446-aaf9-f59c40ec06f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:19.908904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-795a3c1c-f429-4446-aaf9-f59c40ec06f2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:19.910113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-795a3c1c-f429-4446-aaf9-f59c40ec06f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:20.043712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 15/28] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:20.054942 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb6a5e-3703-4d51-83d5-6abfc4e7fc41 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:20.080228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3c1c-f429-4446-aaf9-f59c40ec06f2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:20.107117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8705d9-1d94-4ef2-811c-50b2640f3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:20.108499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8705d9-1d94-4ef2-811c-50b2640f3340 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:20.108785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8705d9-1d94-4ef2-811c-50b2640f3340 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:20.109060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8705d9-1d94-4ef2-811c-50b2640f3340 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:20.110759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8705d9-1d94-4ef2-811c-50b2640f3340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:20.112377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8705d9-1d94-4ef2-811c-50b2640f3340 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:20.114281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 14/29] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:20.120126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8705d9-1d94-4ef2-811c-50b2640f3340 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:20.194854 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a3c1c-f429-4446-aaf9-f59c40ec06f2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:20.241700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12095d53-4bba-43cf-8b94-74db04ed4128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:20.242543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095d53-4bba-43cf-8b94-74db04ed4128 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:20.242825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095d53-4bba-43cf-8b94-74db04ed4128 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:20.243099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095d53-4bba-43cf-8b94-74db04ed4128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:20.263772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12095d53-4bba-43cf-8b94-74db04ed4128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:20.265780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12095d53-4bba-43cf-8b94-74db04ed4128 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:20.292617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8705d9-1d94-4ef2-811c-50b2640f3340 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:20.294083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-12095d53-4bba-43cf-8b94-74db04ed4128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:11:20.295842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 16/30] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:20.297161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d95e3-ad75-4f7a-9862-b1eaace41955 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:20.297449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d95e3-ad75-4f7a-9862-b1eaace41955 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:20.297724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d95e3-ad75-4f7a-9862-b1eaace41955 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:20.307686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 17/31] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:20.308551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d95e3-ad75-4f7a-9862-b1eaace41955 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:20.382958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef20d-e504-478b-a674-5ebd73821cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:20.383856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef20d-e504-478b-a674-5ebd73821cd8 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:20.384145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef20d-e504-478b-a674-5ebd73821cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:20.384433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef20d-e504-478b-a674-5ebd73821cd8 None admin] PATH_INFO: `/v3/domains/default/users/674ef23c54a243f3842909c6f536a72a/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:20.387587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef20d-e504-478b-a674-5ebd73821cd8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=674ef23c54a243f3842909c6f536a72a, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:20.389603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef20d-e504-478b-a674-5ebd73821cd8 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:20.459496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d95e3-ad75-4f7a-9862-b1eaace41955 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:20.514954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9254d3-5a4b-4fbd-afb7-3d2c71334a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:20.515615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9254d3-5a4b-4fbd-afb7-3d2c71334a64 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:20.515900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9254d3-5a4b-4fbd-afb7-3d2c71334a64 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:20.516180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9254d3-5a4b-4fbd-afb7-3d2c71334a64 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:20.516901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9254d3-5a4b-4fbd-afb7-3d2c71334a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:20.517204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9254d3-5a4b-4fbd-afb7-3d2c71334a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:20.518606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9254d3-5a4b-4fbd-afb7-3d2c71334a64 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:20.546638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 18/32] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:20.547903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d022a7-3621-449e-81d7-58d1ad5a5d3c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:20.548194 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d022a7-3621-449e-81d7-58d1ad5a5d3c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:20.548474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d022a7-3621-449e-81d7-58d1ad5a5d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:20.579077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-53d022a7-3621-449e-81d7-58d1ad5a5d3c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:20.586282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-53d022a7-3621-449e-81d7-58d1ad5a5d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:20.587074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 15/33] 10.222.0.32 () {58 vars in 1361 bytes} [Tue Apr 12 00:11:20 2022] PUT /identity/v3/domains/default/users/674ef23c54a243f3842909c6f536a72a/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:11:20.588604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef20d-e504-478b-a674-5ebd73821cd8 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:20.777208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 19/34] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:20.789624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef20d-e504-478b-a674-5ebd73821cd8 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:20.827426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d022a7-3621-449e-81d7-58d1ad5a5d3c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:20.849634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5509b-bc99-4069-852f-b6d7fdb21ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:20.850690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5509b-bc99-4069-852f-b6d7fdb21ef4 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:20.851202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5509b-bc99-4069-852f-b6d7fdb21ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:20.851699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5509b-bc99-4069-852f-b6d7fdb21ef4 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:20.852622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5509b-bc99-4069-852f-b6d7fdb21ef4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:20.858592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5509b-bc99-4069-852f-b6d7fdb21ef4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:20.899054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 16/35] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:11:20 2022] POST /identity/v3/projects => generated 301 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:20.986717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d022a7-3621-449e-81d7-58d1ad5a5d3c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:20.994548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228bab7-0061-4f5d-b9d7-2a2e9e314a0c None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:20.995178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228bab7-0061-4f5d-b9d7-2a2e9e314a0c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:20.995677 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228bab7-0061-4f5d-b9d7-2a2e9e314a0c None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:20.997246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 17/36] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:11:21.021380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30094600-1adf-426d-ac96-1bdf950f3fda None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:21.022039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30094600-1adf-426d-ac96-1bdf950f3fda None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:21.022559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30094600-1adf-426d-ac96-1bdf950f3fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:21.041080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f746c-4573-4c9a-b202-349106d9c842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:21.041080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f746c-4573-4c9a-b202-349106d9c842 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:21.041080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f746c-4573-4c9a-b202-349106d9c842 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:21.041080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f746c-4573-4c9a-b202-349106d9c842 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:21.041480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f746c-4573-4c9a-b202-349106d9c842 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:21.042695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f746c-4573-4c9a-b202-349106d9c842 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:21.048985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-30094600-1adf-426d-ac96-1bdf950f3fda None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:21.051163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-30094600-1adf-426d-ac96-1bdf950f3fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:21.169220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 18/37] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:21.180823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 20/38] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 00:11:20 2022] POST /identity/v3/roles => generated 219 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:11:21.201298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30094600-1adf-426d-ac96-1bdf950f3fda None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:21.309589 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30094600-1adf-426d-ac96-1bdf950f3fda None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:21.349987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e129b-37e8-4ea8-9923-803bbf8f4fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:21.350711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e129b-37e8-4ea8-9923-803bbf8f4fd3 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:21.351004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e129b-37e8-4ea8-9923-803bbf8f4fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:21.351286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e129b-37e8-4ea8-9923-803bbf8f4fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:21.352056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e129b-37e8-4ea8-9923-803bbf8f4fd3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:21.353469 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e129b-37e8-4ea8-9923-803bbf8f4fd3 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:21.370700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 19/39] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 00:11:21 2022] POST /identity/v3/roles => generated 225 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:21.903077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dda014-14cc-427b-bba4-156d457e7ecd None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:21.903568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dda014-14cc-427b-bba4-156d457e7ecd None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:21.903850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dda014-14cc-427b-bba4-156d457e7ecd None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:21.905266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 21/40] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:21.912257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089639f-e28a-4d44-820c-7e3fe064bc7a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:21.912557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089639f-e28a-4d44-820c-7e3fe064bc7a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:21.912863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089639f-e28a-4d44-820c-7e3fe064bc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:21.936311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-9089639f-e28a-4d44-820c-7e3fe064bc7a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:21.937640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9089639f-e28a-4d44-820c-7e3fe064bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:22.023298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 20/41] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:22.049335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dda014-14cc-427b-bba4-156d457e7ecd None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:22.131872 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e0db0-ba93-4111-bed9-0f40eda0a909 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:22.132503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e0db0-ba93-4111-bed9-0f40eda0a909 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:22.132991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e0db0-ba93-4111-bed9-0f40eda0a909 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:22.134803 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 21/42] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:22.140425 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5da4c-8827-4d2f-bde2-89e72de7e785 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:22.140947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5da4c-8827-4d2f-bde2-89e72de7e785 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:22.141440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5da4c-8827-4d2f-bde2-89e72de7e785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:22.156814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dda014-14cc-427b-bba4-156d457e7ecd None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:22.159888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-afe5da4c-8827-4d2f-bde2-89e72de7e785 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:22.161318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-afe5da4c-8827-4d2f-bde2-89e72de7e785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:22.190754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2610664-2977-4210-bbca-3fd4e9f5b208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:22.191480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2610664-2977-4210-bbca-3fd4e9f5b208 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:22.191764 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2610664-2977-4210-bbca-3fd4e9f5b208 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:22.192041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2610664-2977-4210-bbca-3fd4e9f5b208 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:22.193313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2610664-2977-4210-bbca-3fd4e9f5b208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:22.194915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2610664-2977-4210-bbca-3fd4e9f5b208 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:22.196825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 22/43] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:22.206273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2610664-2977-4210-bbca-3fd4e9f5b208 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:22.234892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 22/44] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:22.258910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5da4c-8827-4d2f-bde2-89e72de7e785 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:22.329002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2610664-2977-4210-bbca-3fd4e9f5b208 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:22.363507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5da4c-8827-4d2f-bde2-89e72de7e785 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:22.382609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931fcb4-784f-41aa-9930-e98836e45035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:22.383280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931fcb4-784f-41aa-9930-e98836e45035 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:22.383567 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931fcb4-784f-41aa-9930-e98836e45035 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:22.383844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931fcb4-784f-41aa-9930-e98836e45035 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:22.384553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931fcb4-784f-41aa-9930-e98836e45035 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:22.386006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931fcb4-784f-41aa-9930-e98836e45035 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:22.412094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca36be9-d8bb-4026-9775-fc45bf40a3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:22.414465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca36be9-d8bb-4026-9775-fc45bf40a3e1 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:22.414951 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca36be9-d8bb-4026-9775-fc45bf40a3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:22.415520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca36be9-d8bb-4026-9775-fc45bf40a3e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:22.418002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca36be9-d8bb-4026-9775-fc45bf40a3e1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:22.419598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca36be9-d8bb-4026-9775-fc45bf40a3e1 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:22.420966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 23/45] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:11:22 2022] POST /identity/v3/projects => generated 312 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:11:22.448094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 00:11:22 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:11:23.523027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e97a73-a3b9-4d32-8cda-08bc1a7afca7 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:23.523573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e97a73-a3b9-4d32-8cda-08bc1a7afca7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:23.523573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e97a73-a3b9-4d32-8cda-08bc1a7afca7 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:23.524959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 24/47] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:23.530887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa775-56cf-4e20-82f2-1da973754c55 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:23.531305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa775-56cf-4e20-82f2-1da973754c55 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:23.531454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa775-56cf-4e20-82f2-1da973754c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:23.548922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d78aa775-56cf-4e20-82f2-1da973754c55 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:23.550142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d78aa775-56cf-4e20-82f2-1da973754c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:23.628289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 24/48] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:23.653141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e97a73-a3b9-4d32-8cda-08bc1a7afca7 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:23.765311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e97a73-a3b9-4d32-8cda-08bc1a7afca7 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:23.799505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc579e-1d47-4eb2-b029-060ca41c371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:23.800232 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc579e-1d47-4eb2-b029-060ca41c371a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:23.800516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc579e-1d47-4eb2-b029-060ca41c371a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:23.800792 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc579e-1d47-4eb2-b029-060ca41c371a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:23.810441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc579e-1d47-4eb2-b029-060ca41c371a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:23.817495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-3bdc579e-1d47-4eb2-b029-060ca41c371a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:11:23.818914 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 25/49] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:23.824630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aa775-56cf-4e20-82f2-1da973754c55 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:23.918417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aa775-56cf-4e20-82f2-1da973754c55 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:23.952584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b3c28-f401-4ac2-9294-233b3963ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:23.953260 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b3c28-f401-4ac2-9294-233b3963ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:23.953541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b3c28-f401-4ac2-9294-233b3963ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:23.953813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b3c28-f401-4ac2-9294-233b3963ecb8 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:23.954584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b3c28-f401-4ac2-9294-233b3963ecb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:23.954892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b3c28-f401-4ac2-9294-233b3963ecb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:23.956271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b3c28-f401-4ac2-9294-233b3963ecb8 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:23.964455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 25/50] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:23.970244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc579e-1d47-4eb2-b029-060ca41c371a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:24.073115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc579e-1d47-4eb2-b029-060ca41c371a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:24.107413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063146cf-3d83-4773-895b-08965e5fbaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:24.108348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063146cf-3d83-4773-895b-08965e5fbaf1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:24.108635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063146cf-3d83-4773-895b-08965e5fbaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:24.108913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063146cf-3d83-4773-895b-08965e5fbaf1 None admin] PATH_INFO: `/v3/users/674ef23c54a243f3842909c6f536a72a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:24.110131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063146cf-3d83-4773-895b-08965e5fbaf1 None admin] RBAC: Authorizing `identity:get_user(user_id=674ef23c54a243f3842909c6f536a72a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:24.111654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063146cf-3d83-4773-895b-08965e5fbaf1 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:24.113500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 26/51] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:23 2022] GET /identity/v3/users/674ef23c54a243f3842909c6f536a72a => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:24.118978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b3c28-f401-4ac2-9294-233b3963ecb8 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:24.215553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b3c28-f401-4ac2-9294-233b3963ecb8 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:24.247367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b228e4-be1a-42ed-af89-b60d898a1d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:24.248696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b228e4-be1a-42ed-af89-b60d898a1d14 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:24.248979 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b228e4-be1a-42ed-af89-b60d898a1d14 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:24.249253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b228e4-be1a-42ed-af89-b60d898a1d14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:24.250463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b228e4-be1a-42ed-af89-b60d898a1d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:24.251930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b228e4-be1a-42ed-af89-b60d898a1d14 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:24.253711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 26/52] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:24.259285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063146cf-3d83-4773-895b-08965e5fbaf1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:24.355316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063146cf-3d83-4773-895b-08965e5fbaf1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:24.387136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe9f42-de4d-4d20-b49c-2cd5a3d0e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:24.387805 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe9f42-de4d-4d20-b49c-2cd5a3d0e228 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:24.388090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe9f42-de4d-4d20-b49c-2cd5a3d0e228 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:24.388367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe9f42-de4d-4d20-b49c-2cd5a3d0e228 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:24.389296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe9f42-de4d-4d20-b49c-2cd5a3d0e228 None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.domain.id=default, user.id=674ef23c54a243f3842909c6f536a72a) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:24.389606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe9f42-de4d-4d20-b49c-2cd5a3d0e228 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:24.391076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe9f42-de4d-4d20-b49c-2cd5a3d0e228 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:24.397310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1322 bytes} [Tue Apr 12 00:11:24 2022] GET /identity/v3/role_assignments?user.id=674ef23c54a243f3842909c6f536a72a&scope.domain.id=default&role.id=f0208c43117c4b799194c83781a46e09 => generated 530 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:24.822850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c15b-70bf-4962-9037-ead96a7e4cbf None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:24.823357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c15b-70bf-4962-9037-ead96a7e4cbf None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:24.823461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c15b-70bf-4962-9037-ead96a7e4cbf None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:24.824798 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 27/54] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:24.830534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fb41c-ec67-44cf-8a2b-ecf73d67ec76 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:24.830939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fb41c-ec67-44cf-8a2b-ecf73d67ec76 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:24.831116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fb41c-ec67-44cf-8a2b-ecf73d67ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:24.847676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-340fb41c-ec67-44cf-8a2b-ecf73d67ec76 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:24.849209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-340fb41c-ec67-44cf-8a2b-ecf73d67ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:24.912425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 28/55] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:24.938003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c15b-70bf-4962-9037-ead96a7e4cbf None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:25.035935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c15b-70bf-4962-9037-ead96a7e4cbf None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:25.067696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d2198-620e-4c51-8346-4456de0bb702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:25.068485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2198-620e-4c51-8346-4456de0bb702 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:25.068776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2198-620e-4c51-8346-4456de0bb702 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:25.069071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d2198-620e-4c51-8346-4456de0bb702 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:25.070226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d2198-620e-4c51-8346-4456de0bb702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:25.071701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d2198-620e-4c51-8346-4456de0bb702 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:25.073480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 28/56] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:25.078857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fb41c-ec67-44cf-8a2b-ecf73d67ec76 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:25.172025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fb41c-ec67-44cf-8a2b-ecf73d67ec76 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:25.202845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da6bcf-0cdf-4702-b8dd-e4a83b26759f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:25.203441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da6bcf-0cdf-4702-b8dd-e4a83b26759f None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:25.203726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da6bcf-0cdf-4702-b8dd-e4a83b26759f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:25.204003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da6bcf-0cdf-4702-b8dd-e4a83b26759f None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:25.204703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da6bcf-0cdf-4702-b8dd-e4a83b26759f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:25.206168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da6bcf-0cdf-4702-b8dd-e4a83b26759f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:25.230918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 29/57] 10.222.0.32 () {60 vars in 1140 bytes} [Tue Apr 12 00:11:25 2022] POST /identity/v3/projects => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:27.530886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8b75e-a806-4da8-af57-bf56079dcb5a None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:27.531400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8b75e-a806-4da8-af57-bf56079dcb5a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:27.531486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8b75e-a806-4da8-af57-bf56079dcb5a None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:27.532796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 29/58] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:27.537787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aa3ce-2eee-47af-a4b9-1687df3c9f60 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:27.538154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aa3ce-2eee-47af-a4b9-1687df3c9f60 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:27.538387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0aa3ce-2eee-47af-a4b9-1687df3c9f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:27.555484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fd0aa3ce-2eee-47af-a4b9-1687df3c9f60 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:27.556658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fd0aa3ce-2eee-47af-a4b9-1687df3c9f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:27.619026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 30/59] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:27.644909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8b75e-a806-4da8-af57-bf56079dcb5a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:27.740658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8b75e-a806-4da8-af57-bf56079dcb5a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:27.771224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c740a1f-252f-409a-a6ad-e4dacc6ce2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:27.772003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c740a1f-252f-409a-a6ad-e4dacc6ce2e4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:27.772290 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c740a1f-252f-409a-a6ad-e4dacc6ce2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:27.772569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c740a1f-252f-409a-a6ad-e4dacc6ce2e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:27.773718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c740a1f-252f-409a-a6ad-e4dacc6ce2e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:27.775173 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c740a1f-252f-409a-a6ad-e4dacc6ce2e4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:27.776750 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 30/60] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:27.782909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aa3ce-2eee-47af-a4b9-1687df3c9f60 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:27.874054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0aa3ce-2eee-47af-a4b9-1687df3c9f60 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:27.905897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801e796-aa92-4a12-a9e7-c7aede995692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:27.906585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e796-aa92-4a12-a9e7-c7aede995692 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:27.906875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e796-aa92-4a12-a9e7-c7aede995692 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:27.907155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801e796-aa92-4a12-a9e7-c7aede995692 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:27.907865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801e796-aa92-4a12-a9e7-c7aede995692 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:27.909303 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801e796-aa92-4a12-a9e7-c7aede995692 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:27.933062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 31/61] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:11:27 2022] POST /identity/v3/users => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:31.472517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873e72a-1ddd-494c-a752-a37b1024ba46 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.473575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873e72a-1ddd-494c-a752-a37b1024ba46 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.474085 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873e72a-1ddd-494c-a752-a37b1024ba46 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:31.476010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 31/62] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:31.481581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6c359-fd63-4fa0-b1a1-0ac80b171f21 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.482954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6c359-fd63-4fa0-b1a1-0ac80b171f21 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.483439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6c359-fd63-4fa0-b1a1-0ac80b171f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:31.501698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-faf6c359-fd63-4fa0-b1a1-0ac80b171f21 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:31.503010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-faf6c359-fd63-4fa0-b1a1-0ac80b171f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:31.580211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe854cba-3781-4664-b655-c17b84a7d25b None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.580930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe854cba-3781-4664-b655-c17b84a7d25b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.581434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe854cba-3781-4664-b655-c17b84a7d25b None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:31.583666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:31.589055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29a36e-ebfa-4e15-b3d3-276ff829f7a0 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.589874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29a36e-ebfa-4e15-b3d3-276ff829f7a0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.590408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29a36e-ebfa-4e15-b3d3-276ff829f7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:31.594655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 32/64] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:31.608439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0e29a36e-ebfa-4e15-b3d3-276ff829f7a0 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:31.609927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0e29a36e-ebfa-4e15-b3d3-276ff829f7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:31.633180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6c359-fd63-4fa0-b1a1-0ac80b171f21 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:31.698055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 33/65] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Apr 12 00:11:31.705918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d76f7-11d2-4722-8d02-9d619c50cad2 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.705918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d76f7-11d2-4722-8d02-9d619c50cad2 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.705918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d76f7-11d2-4722-8d02-9d619c50cad2 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:31.705918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 34/66] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:31.713357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f09a38-c756-445a-bbf5-477f732c791b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.713650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f09a38-c756-445a-bbf5-477f732c791b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.713931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f09a38-c756-445a-bbf5-477f732c791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:31.738612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f4f09a38-c756-445a-bbf5-477f732c791b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:31.739713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f4f09a38-c756-445a-bbf5-477f732c791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:31.780119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6c359-fd63-4fa0-b1a1-0ac80b171f21 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:31.805442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 35/67] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:31.806649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f09a38-c756-445a-bbf5-477f732c791b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:31.830609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ebd5b-6e28-451c-b023-d2b6c7da5251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:31.832536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebd5b-6e28-451c-b023-d2b6c7da5251 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.832826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebd5b-6e28-451c-b023-d2b6c7da5251 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.833117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ebd5b-6e28-451c-b023-d2b6c7da5251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:31.845848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ebd5b-6e28-451c-b023-d2b6c7da5251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:31.852659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-039ebd5b-6e28-451c-b023-d2b6c7da5251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:11:31.854999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 33/68] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:11:31.854999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ebd5b-6e28-451c-b023-d2b6c7da5251 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:31.917484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f09a38-c756-445a-bbf5-477f732c791b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:31.950891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ebd5b-6e28-451c-b023-d2b6c7da5251 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:31.951264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeff31-086a-4855-b21f-3dd94e41ee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:31.952067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeff31-086a-4855-b21f-3dd94e41ee09 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.952355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeff31-086a-4855-b21f-3dd94e41ee09 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.952644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeff31-086a-4855-b21f-3dd94e41ee09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:31.963731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeff31-086a-4855-b21f-3dd94e41ee09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:31.971164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-91eeff31-086a-4855-b21f-3dd94e41ee09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:11:31.977076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 36/69] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:31.977076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec61d0a-002b-4f36-807f-a62e9f0d3dda None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.977076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec61d0a-002b-4f36-807f-a62e9f0d3dda None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.977076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec61d0a-002b-4f36-807f-a62e9f0d3dda None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:31.978667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 37/70] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:31.979920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec61d0a-002b-4f36-807f-a62e9f0d3dda None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:31.989809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e01ee-4f33-4bd8-969c-24fb3ba0c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:31.990607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e01ee-4f33-4bd8-969c-24fb3ba0c55f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:31.990892 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e01ee-4f33-4bd8-969c-24fb3ba0c55f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:31.991172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e01ee-4f33-4bd8-969c-24fb3ba0c55f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.001730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e01ee-4f33-4bd8-969c-24fb3ba0c55f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:32.008982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-410e01ee-4f33-4bd8-969c-24fb3ba0c55f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:11:32.010193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 34/71] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:11:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:32.012321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e01ee-4f33-4bd8-969c-24fb3ba0c55f None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.082515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec61d0a-002b-4f36-807f-a62e9f0d3dda None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.110856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e01ee-4f33-4bd8-969c-24fb3ba0c55f None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.114485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76335222-daf8-40b0-9aa5-84c5567e77b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.115156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76335222-daf8-40b0-9aa5-84c5567e77b0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.115446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76335222-daf8-40b0-9aa5-84c5567e77b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.115725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76335222-daf8-40b0-9aa5-84c5567e77b0 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.116471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76335222-daf8-40b0-9aa5-84c5567e77b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:32.116779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76335222-daf8-40b0-9aa5-84c5567e77b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:32.118171 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76335222-daf8-40b0-9aa5-84c5567e77b0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:32.126227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 38/72] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:32.127422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab652153-d121-43ec-96ff-482755e55421 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.127712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab652153-d121-43ec-96ff-482755e55421 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.127992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab652153-d121-43ec-96ff-482755e55421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.143647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ab652153-d121-43ec-96ff-482755e55421 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:32.143808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0b7c-7b82-4319-953e-5bd8aa7eba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.144315 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0b7c-7b82-4319-953e-5bd8aa7eba4a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.144600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0b7c-7b82-4319-953e-5bd8aa7eba4a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.144816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ab652153-d121-43ec-96ff-482755e55421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:32.144911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f0b7c-7b82-4319-953e-5bd8aa7eba4a None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.145605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f0b7c-7b82-4319-953e-5bd8aa7eba4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:32.145908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f0b7c-7b82-4319-953e-5bd8aa7eba4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:32.147311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f0b7c-7b82-4319-953e-5bd8aa7eba4a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:32.155717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 35/73] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:32.157566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0b7c-7b82-4319-953e-5bd8aa7eba4a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.208197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 39/74] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:32.210651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57356cc-18cf-4891-a8ba-4270c852d965 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.210944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57356cc-18cf-4891-a8ba-4270c852d965 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.211224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57356cc-18cf-4891-a8ba-4270c852d965 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.212637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 40/75] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:32.213184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57356cc-18cf-4891-a8ba-4270c852d965 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.255252 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f0b7c-7b82-4319-953e-5bd8aa7eba4a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.288086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24492ee-8194-4d18-9e8f-41a43c285b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.288757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24492ee-8194-4d18-9e8f-41a43c285b27 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.289085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24492ee-8194-4d18-9e8f-41a43c285b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.289389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24492ee-8194-4d18-9e8f-41a43c285b27 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.290471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24492ee-8194-4d18-9e8f-41a43c285b27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:32.290807 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24492ee-8194-4d18-9e8f-41a43c285b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:32.292248 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24492ee-8194-4d18-9e8f-41a43c285b27 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:32.299897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 36/76] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:32.301758 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24492ee-8194-4d18-9e8f-41a43c285b27 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.312042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57356cc-18cf-4891-a8ba-4270c852d965 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.344844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e58037-06b1-4e96-ba1e-6bc1d1c2d168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.345712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e58037-06b1-4e96-ba1e-6bc1d1c2d168 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.346000 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e58037-06b1-4e96-ba1e-6bc1d1c2d168 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.346296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e58037-06b1-4e96-ba1e-6bc1d1c2d168 None admin] PATH_INFO: `/v3/users/f75b0fefc7e946f3a9e33757e996c8eb` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.360897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e58037-06b1-4e96-ba1e-6bc1d1c2d168 None admin] RBAC: Authorizing `identity:get_user(user_id=f75b0fefc7e946f3a9e33757e996c8eb)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:32.362381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e58037-06b1-4e96-ba1e-6bc1d1c2d168 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:32.364035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 41/77] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/users/f75b0fefc7e946f3a9e33757e996c8eb => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:32.365188 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df7f9-8c48-44c5-a6b5-94f6cc39db4f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.365483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df7f9-8c48-44c5-a6b5-94f6cc39db4f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.365769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1df7f9-8c48-44c5-a6b5-94f6cc39db4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.382958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-7a1df7f9-8c48-44c5-a6b5-94f6cc39db4f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:32.384126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7a1df7f9-8c48-44c5-a6b5-94f6cc39db4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:32.397310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24492ee-8194-4d18-9e8f-41a43c285b27 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.429084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2da6d-c786-4551-a74f-03daacce0ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.429954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2da6d-c786-4551-a74f-03daacce0ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.430279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2da6d-c786-4551-a74f-03daacce0ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.430549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2da6d-c786-4551-a74f-03daacce0ed4 None admin] PATH_INFO: `/v3/users/674ef23c54a243f3842909c6f536a72a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.431746 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2da6d-c786-4551-a74f-03daacce0ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=674ef23c54a243f3842909c6f536a72a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:32.433173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2da6d-c786-4551-a74f-03daacce0ed4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:32.434810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 37/78] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/users/674ef23c54a243f3842909c6f536a72a => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:32.436190 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2da6d-c786-4551-a74f-03daacce0ed4 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.447149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 42/79] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:32.449017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1df7f9-8c48-44c5-a6b5-94f6cc39db4f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.530457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2da6d-c786-4551-a74f-03daacce0ed4 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.540892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1df7f9-8c48-44c5-a6b5-94f6cc39db4f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.562219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f41f5-9d31-40d1-b185-19573e73b8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.563044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f41f5-9d31-40d1-b185-19573e73b8bb None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.563337 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f41f5-9d31-40d1-b185-19573e73b8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.563620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f41f5-9d31-40d1-b185-19573e73b8bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.572694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86065e-e3cf-43ac-8167-b49b5e702b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.573430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f41f5-9d31-40d1-b185-19573e73b8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:32.573553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86065e-e3cf-43ac-8167-b49b5e702b45 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.573840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86065e-e3cf-43ac-8167-b49b5e702b45 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.574117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86065e-e3cf-43ac-8167-b49b5e702b45 None admin] PATH_INFO: `/v3/users/f75b0fefc7e946f3a9e33757e996c8eb` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.575333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86065e-e3cf-43ac-8167-b49b5e702b45 None admin] RBAC: Authorizing `identity:get_user(user_id=f75b0fefc7e946f3a9e33757e996c8eb)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:32.576827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86065e-e3cf-43ac-8167-b49b5e702b45 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:32.578467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 43/80] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/users/f75b0fefc7e946f3a9e33757e996c8eb => generated 275 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:32.579223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86065e-e3cf-43ac-8167-b49b5e702b45 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.580533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-2b7f41f5-9d31-40d1-b185-19573e73b8bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:11:32.581871 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 38/81] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:32.585266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f41f5-9d31-40d1-b185-19573e73b8bb None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.673109 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86065e-e3cf-43ac-8167-b49b5e702b45 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.680071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f41f5-9d31-40d1-b185-19573e73b8bb None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.704227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9257fd-fd86-47a1-abc2-4aeaf7a814df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.704883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9257fd-fd86-47a1-abc2-4aeaf7a814df None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.705162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9257fd-fd86-47a1-abc2-4aeaf7a814df None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.705440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9257fd-fd86-47a1-abc2-4aeaf7a814df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.711176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982bfd-7c7a-4eee-b9f7-eac110579dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.711823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982bfd-7c7a-4eee-b9f7-eac110579dde None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.712114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982bfd-7c7a-4eee-b9f7-eac110579dde None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.712395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982bfd-7c7a-4eee-b9f7-eac110579dde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.767104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9257fd-fd86-47a1-abc2-4aeaf7a814df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:32.768556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9257fd-fd86-47a1-abc2-4aeaf7a814df None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:32.775311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49982bfd-7c7a-4eee-b9f7-eac110579dde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:32.776771 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49982bfd-7c7a-4eee-b9f7-eac110579dde None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:32.860459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 44/82] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:32.861280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9257fd-fd86-47a1-abc2-4aeaf7a814df None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.868628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 39/83] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:32.869445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982bfd-7c7a-4eee-b9f7-eac110579dde None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.952152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9257fd-fd86-47a1-abc2-4aeaf7a814df None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.959310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982bfd-7c7a-4eee-b9f7-eac110579dde None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:32.983653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a2eff-0ffa-4547-a882-4a830c5dd5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.984454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a2eff-0ffa-4547-a882-4a830c5dd5c4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.984744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a2eff-0ffa-4547-a882-4a830c5dd5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.985023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a2eff-0ffa-4547-a882-4a830c5dd5c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:32.986178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a2eff-0ffa-4547-a882-4a830c5dd5c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:32.987662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a2eff-0ffa-4547-a882-4a830c5dd5c4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:32.989428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 45/84] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:32.990092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a2eff-0ffa-4547-a882-4a830c5dd5c4 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:32.995293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dc187-c9e9-4578-a180-849be5e8ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:32.995945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dc187-c9e9-4578-a180-849be5e8ab1e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:32.996232 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dc187-c9e9-4578-a180-849be5e8ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:32.996509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dc187-c9e9-4578-a180-849be5e8ab1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.059092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dc187-c9e9-4578-a180-849be5e8ab1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.061161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dc187-c9e9-4578-a180-849be5e8ab1e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.081291 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a2eff-0ffa-4547-a882-4a830c5dd5c4 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.112750 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41a5bf-3f03-4d30-8493-8ea13bc8e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.113347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41a5bf-3f03-4d30-8493-8ea13bc8e2db None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.113629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41a5bf-3f03-4d30-8493-8ea13bc8e2db None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.113901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41a5bf-3f03-4d30-8493-8ea13bc8e2db None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.114672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41a5bf-3f03-4d30-8493-8ea13bc8e2db None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:33.114976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41a5bf-3f03-4d30-8493-8ea13bc8e2db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.116305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41a5bf-3f03-4d30-8493-8ea13bc8e2db None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.124380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 46/85] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:33.125133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41a5bf-3f03-4d30-8493-8ea13bc8e2db None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:33.156927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 40/86] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:33.157942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dc187-c9e9-4578-a180-849be5e8ab1e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:33.216731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41a5bf-3f03-4d30-8493-8ea13bc8e2db None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.248716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfa9fd-5698-4b12-bd72-c4e246c2e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.249011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dc187-c9e9-4578-a180-849be5e8ab1e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.249587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfa9fd-5698-4b12-bd72-c4e246c2e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.249877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfa9fd-5698-4b12-bd72-c4e246c2e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.250157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfa9fd-5698-4b12-bd72-c4e246c2e6a1 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.251374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfa9fd-5698-4b12-bd72-c4e246c2e6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.252816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfa9fd-5698-4b12-bd72-c4e246c2e6a1 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.254787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 47/87] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:33 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:33.255407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfa9fd-5698-4b12-bd72-c4e246c2e6a1 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:33.281610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762ba2d-a805-417e-8b89-7650c3d86223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.282496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762ba2d-a805-417e-8b89-7650c3d86223 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.282786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762ba2d-a805-417e-8b89-7650c3d86223 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.283066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762ba2d-a805-417e-8b89-7650c3d86223 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.284248 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762ba2d-a805-417e-8b89-7650c3d86223 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.285721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5762ba2d-a805-417e-8b89-7650c3d86223 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.287423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 41/88] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:33 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:33.288180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762ba2d-a805-417e-8b89-7650c3d86223 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:33.348685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfa9fd-5698-4b12-bd72-c4e246c2e6a1 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.379624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762ba2d-a805-417e-8b89-7650c3d86223 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.380036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcb249-4672-4c14-bec7-0a62f39909e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.380709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcb249-4672-4c14-bec7-0a62f39909e6 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.381002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcb249-4672-4c14-bec7-0a62f39909e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.381288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcb249-4672-4c14-bec7-0a62f39909e6 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.382003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcb249-4672-4c14-bec7-0a62f39909e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.383465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcb249-4672-4c14-bec7-0a62f39909e6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.407661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 48/89] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:11:33 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:33.408484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcb249-4672-4c14-bec7-0a62f39909e6 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:33.429093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf72d64-e2b9-4bdc-be68-ec59aca59206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.430405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf72d64-e2b9-4bdc-be68-ec59aca59206 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.430865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf72d64-e2b9-4bdc-be68-ec59aca59206 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.431268 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf72d64-e2b9-4bdc-be68-ec59aca59206 None admin] PATH_INFO: `/v3/users/f75b0fefc7e946f3a9e33757e996c8eb` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.432661 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf72d64-e2b9-4bdc-be68-ec59aca59206 None admin] RBAC: Authorizing `identity:get_user(user_id=f75b0fefc7e946f3a9e33757e996c8eb)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.434202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf72d64-e2b9-4bdc-be68-ec59aca59206 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.436742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 42/90] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:33 2022] GET /identity/v3/users/f75b0fefc7e946f3a9e33757e996c8eb => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:33.437390 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf72d64-e2b9-4bdc-be68-ec59aca59206 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:33.515797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcb249-4672-4c14-bec7-0a62f39909e6 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.546091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf72d64-e2b9-4bdc-be68-ec59aca59206 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.550216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8459ded-4410-467f-9ce4-c3bf3926b725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.551124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8459ded-4410-467f-9ce4-c3bf3926b725 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.551411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8459ded-4410-467f-9ce4-c3bf3926b725 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.551684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8459ded-4410-467f-9ce4-c3bf3926b725 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.552907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8459ded-4410-467f-9ce4-c3bf3926b725 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.554405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8459ded-4410-467f-9ce4-c3bf3926b725 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.561746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 49/91] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:33 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:33.561746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8459ded-4410-467f-9ce4-c3bf3926b725 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:33.589086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73acee-2e5f-407c-a04b-091f13378d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.589751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73acee-2e5f-407c-a04b-091f13378d5d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.590038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73acee-2e5f-407c-a04b-091f13378d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.590342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73acee-2e5f-407c-a04b-091f13378d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.591174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73acee-2e5f-407c-a04b-091f13378d5d None admin] RBAC: Adding query filter params (role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c, user.id=f75b0fefc7e946f3a9e33757e996c8eb) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:33.591484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73acee-2e5f-407c-a04b-091f13378d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.592951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73acee-2e5f-407c-a04b-091f13378d5d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.606474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 43/92] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:33 2022] GET /identity/v3/role_assignments?user.id=f75b0fefc7e946f3a9e33757e996c8eb&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:33.608430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73acee-2e5f-407c-a04b-091f13378d5d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:33.668191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8459ded-4410-467f-9ce4-c3bf3926b725 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.708915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f8ad5-1a8a-4e88-b34e-ee73f1374326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.709597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f8ad5-1a8a-4e88-b34e-ee73f1374326 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.709883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f8ad5-1a8a-4e88-b34e-ee73f1374326 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.710163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f8ad5-1a8a-4e88-b34e-ee73f1374326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.711111 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f8ad5-1a8a-4e88-b34e-ee73f1374326 None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c, user.id=674ef23c54a243f3842909c6f536a72a) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:33.711430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f8ad5-1a8a-4e88-b34e-ee73f1374326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.712925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f8ad5-1a8a-4e88-b34e-ee73f1374326 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.721700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 50/93] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:33 2022] GET /identity/v3/role_assignments?user.id=674ef23c54a243f3842909c6f536a72a&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=f0208c43117c4b799194c83781a46e09 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:33.721885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73acee-2e5f-407c-a04b-091f13378d5d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.722590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f8ad5-1a8a-4e88-b34e-ee73f1374326 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:33.763440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5001808-c4d2-4131-9ee9-38ebe1658879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.764696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001808-c4d2-4131-9ee9-38ebe1658879 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.765047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001808-c4d2-4131-9ee9-38ebe1658879 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.765264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5001808-c4d2-4131-9ee9-38ebe1658879 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.870499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5001808-c4d2-4131-9ee9-38ebe1658879 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.872913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5001808-c4d2-4131-9ee9-38ebe1658879 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.876331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f8ad5-1a8a-4e88-b34e-ee73f1374326 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:33.921471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e5a83-2db9-4cd7-a2b1-ee392ece80ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:33.922076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e5a83-2db9-4cd7-a2b1-ee392ece80ca None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:33.922410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e5a83-2db9-4cd7-a2b1-ee392ece80ca None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:33.922694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e5a83-2db9-4cd7-a2b1-ee392ece80ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:33.923549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e5a83-2db9-4cd7-a2b1-ee392ece80ca None admin] RBAC: Adding query filter params (role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c, user.id=f75b0fefc7e946f3a9e33757e996c8eb) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:33.923863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e5a83-2db9-4cd7-a2b1-ee392ece80ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:33.925981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e5a83-2db9-4cd7-a2b1-ee392ece80ca None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:33.935051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 51/94] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:33 2022] GET /identity/v3/role_assignments?user.id=f75b0fefc7e946f3a9e33757e996c8eb&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:33.994845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 44/95] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:34.001608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e5a83-2db9-4cd7-a2b1-ee392ece80ca None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:34.142511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e5a83-2db9-4cd7-a2b1-ee392ece80ca None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:34.181664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df535b-a6fe-4ea5-a855-8b8caa64ecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:34.182582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df535b-a6fe-4ea5-a855-8b8caa64ecf6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:34.182870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df535b-a6fe-4ea5-a855-8b8caa64ecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:34.183148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df535b-a6fe-4ea5-a855-8b8caa64ecf6 None admin] PATH_INFO: `/v3/projects/f9ae6399b4224e7ebe92f8bad4da7fb6` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:34.184346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df535b-a6fe-4ea5-a855-8b8caa64ecf6 None admin] RBAC: Authorizing `identity:get_project(project_id=f9ae6399b4224e7ebe92f8bad4da7fb6)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:34.185875 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df535b-a6fe-4ea5-a855-8b8caa64ecf6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:34.187605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 52/96] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:34 2022] GET /identity/v3/projects/f9ae6399b4224e7ebe92f8bad4da7fb6 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:34.193740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5001808-c4d2-4131-9ee9-38ebe1658879 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:34.314029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5001808-c4d2-4131-9ee9-38ebe1658879 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:34.359110 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05412b-dfda-4f4c-9fd1-06e213856da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:34.359775 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05412b-dfda-4f4c-9fd1-06e213856da6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:34.360058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05412b-dfda-4f4c-9fd1-06e213856da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:34.360337 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05412b-dfda-4f4c-9fd1-06e213856da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:34.361162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05412b-dfda-4f4c-9fd1-06e213856da6 None admin] RBAC: Adding query filter params (role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=f9ae6399b4224e7ebe92f8bad4da7fb6, user.id=f75b0fefc7e946f3a9e33757e996c8eb) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:34.361470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05412b-dfda-4f4c-9fd1-06e213856da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:34.362948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05412b-dfda-4f4c-9fd1-06e213856da6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:34.374857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 45/97] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:34 2022] GET /identity/v3/role_assignments?user.id=f75b0fefc7e946f3a9e33757e996c8eb&scope.project.id=f9ae6399b4224e7ebe92f8bad4da7fb6&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:36.513255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc959e-e3f0-4994-a168-322c7eaef380 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:36.513799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc959e-e3f0-4994-a168-322c7eaef380 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:36.513874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc959e-e3f0-4994-a168-322c7eaef380 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:36.515568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 53/98] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:36.520568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54527f7-9451-4521-97c4-c310efef4bcd None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:36.521369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54527f7-9451-4521-97c4-c310efef4bcd None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:36.521865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54527f7-9451-4521-97c4-c310efef4bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:36.543923 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d54527f7-9451-4521-97c4-c310efef4bcd None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:36.545596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d54527f7-9451-4521-97c4-c310efef4bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:36.632913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 46/99] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:36.667654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc959e-e3f0-4994-a168-322c7eaef380 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:36.794435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc959e-e3f0-4994-a168-322c7eaef380 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:36.828229 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b5134-0a49-4ee6-89e3-89064db45ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:36.829042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5134-0a49-4ee6-89e3-89064db45ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:36.829334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5134-0a49-4ee6-89e3-89064db45ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:36.829616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5134-0a49-4ee6-89e3-89064db45ae0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:36.839878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b5134-0a49-4ee6-89e3-89064db45ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:36.847470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-314b5134-0a49-4ee6-89e3-89064db45ae0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:11:36.849096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 54/100] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:36.855357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54527f7-9451-4521-97c4-c310efef4bcd None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.004369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54527f7-9451-4521-97c4-c310efef4bcd None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:37.015907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda8cc9-527d-47d0-9182-4230db776082 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.016201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda8cc9-527d-47d0-9182-4230db776082 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.016490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda8cc9-527d-47d0-9182-4230db776082 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.018590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 55/101] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:37.024482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46c88-396f-4f84-9cdb-00ff8d469472 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.024806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46c88-396f-4f84-9cdb-00ff8d469472 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.025058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d46c88-396f-4f84-9cdb-00ff8d469472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.046883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258676c-c345-49ce-8e84-c47c3f1b24ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:37.047494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258676c-c345-49ce-8e84-c47c3f1b24ca None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.047783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258676c-c345-49ce-8e84-c47c3f1b24ca None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.048061 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258676c-c345-49ce-8e84-c47c3f1b24ca None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.048825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258676c-c345-49ce-8e84-c47c3f1b24ca None admin] RBAC: Adding query filter params (name=member) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:37.049134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258676c-c345-49ce-8e84-c47c3f1b24ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:37.049643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-19d46c88-396f-4f84-9cdb-00ff8d469472 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:37.050554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e258676c-c345-49ce-8e84-c47c3f1b24ca None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:37.050903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-19d46c88-396f-4f84-9cdb-00ff8d469472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:37.059320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 47/102] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:37.066199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258676c-c345-49ce-8e84-c47c3f1b24ca None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.126366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 56/103] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:11:37.145466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46c88-396f-4f84-9cdb-00ff8d469472 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.193080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258676c-c345-49ce-8e84-c47c3f1b24ca None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:37.226956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e45e4-139b-4855-b4b5-64844c86d2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:37.227840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e45e4-139b-4855-b4b5-64844c86d2ab None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.228125 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e45e4-139b-4855-b4b5-64844c86d2ab None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.228403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e45e4-139b-4855-b4b5-64844c86d2ab None admin] PATH_INFO: `/v3/users/f75b0fefc7e946f3a9e33757e996c8eb` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.229623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e45e4-139b-4855-b4b5-64844c86d2ab None admin] RBAC: Authorizing `identity:get_user(user_id=f75b0fefc7e946f3a9e33757e996c8eb)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:37.231094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e45e4-139b-4855-b4b5-64844c86d2ab None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:37.232831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 48/104] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:37 2022] GET /identity/v3/users/f75b0fefc7e946f3a9e33757e996c8eb => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:37.234063 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f869067-7ae9-49aa-9638-ccaecf347671 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.234386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f869067-7ae9-49aa-9638-ccaecf347671 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.234666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f869067-7ae9-49aa-9638-ccaecf347671 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.235902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 49/105] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:37.240681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f869067-7ae9-49aa-9638-ccaecf347671 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.248246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d46c88-396f-4f84-9cdb-00ff8d469472 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:37.292399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6851e-6225-49dc-9d14-e4faabc65454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:37.293197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6851e-6225-49dc-9d14-e4faabc65454 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.293484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6851e-6225-49dc-9d14-e4faabc65454 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.293763 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6851e-6225-49dc-9d14-e4faabc65454 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.309936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6851e-6225-49dc-9d14-e4faabc65454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:37.319468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-f2f6851e-6225-49dc-9d14-e4faabc65454 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 00:11:37.321596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 57/106] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:37.323368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a985-3a22-44cf-ba77-6574fdec2d08 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.324011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a985-3a22-44cf-ba77-6574fdec2d08 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.324844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a985-3a22-44cf-ba77-6574fdec2d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.344443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f869067-7ae9-49aa-9638-ccaecf347671 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:37.345763 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-dd95a985-3a22-44cf-ba77-6574fdec2d08 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:37.348030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-dd95a985-3a22-44cf-ba77-6574fdec2d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:37.383506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d761a42-3730-4332-b690-e38a7c724cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:37.384648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761a42-3730-4332-b690-e38a7c724cab None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.385100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761a42-3730-4332-b690-e38a7c724cab None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.385569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761a42-3730-4332-b690-e38a7c724cab None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.386936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d761a42-3730-4332-b690-e38a7c724cab None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:37.389489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d761a42-3730-4332-b690-e38a7c724cab None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:37.391398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 50/107] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:37 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:37.392837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb2f39-13c9-4784-826b-d6ec13127f59 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.393315 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb2f39-13c9-4784-826b-d6ec13127f59 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.394179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb2f39-13c9-4784-826b-d6ec13127f59 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.396024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 51/108] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:37.400788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb2f39-13c9-4784-826b-d6ec13127f59 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.429147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 58/109] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:37.435029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a985-3a22-44cf-ba77-6574fdec2d08 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.516431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb2f39-13c9-4784-826b-d6ec13127f59 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:37.548726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a985-3a22-44cf-ba77-6574fdec2d08 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:37.550296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f50b-305c-4c66-b448-60629f6a073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:37.551078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f50b-305c-4c66-b448-60629f6a073d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.551461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f50b-305c-4c66-b448-60629f6a073d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.551824 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f50b-305c-4c66-b448-60629f6a073d None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.553126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f50b-305c-4c66-b448-60629f6a073d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:37.553126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f50b-305c-4c66-b448-60629f6a073d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:37.554547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f50b-305c-4c66-b448-60629f6a073d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:37.563099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 52/110] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:37.564361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf506e-c435-4a4d-a21e-2f269eb52ab5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.564721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf506e-c435-4a4d-a21e-2f269eb52ab5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.565114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf506e-c435-4a4d-a21e-2f269eb52ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.581554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-85bf506e-c435-4a4d-a21e-2f269eb52ab5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:37.582753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-85bf506e-c435-4a4d-a21e-2f269eb52ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:37.587310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6f469-1885-4c2e-9034-28a08a50ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:37.588272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6f469-1885-4c2e-9034-28a08a50ad1d None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.588564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6f469-1885-4c2e-9034-28a08a50ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.588846 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6f469-1885-4c2e-9034-28a08a50ad1d None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/users/f75b0fefc7e946f3a9e33757e996c8eb/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.590854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6f469-1885-4c2e-9034-28a08a50ad1d None admin] RBAC: Authorizing `identity:create_grant(project_id=81d9b125a65a40ef8faf3f1791912d0c, user_id=f75b0fefc7e946f3a9e33757e996c8eb, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:37.592384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6f469-1885-4c2e-9034-28a08a50ad1d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:37.605572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 59/111] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:11:37 2022] PUT /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/users/f75b0fefc7e946f3a9e33757e996c8eb/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:37.606670 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6f469-1885-4c2e-9034-28a08a50ad1d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.673004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 53/112] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:37.682889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf506e-c435-4a4d-a21e-2f269eb52ab5 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.718749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6f469-1885-4c2e-9034-28a08a50ad1d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:37.753328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c5048-3f37-4d5f-be27-406bdd64242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:37.753931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c5048-3f37-4d5f-be27-406bdd64242b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.754223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c5048-3f37-4d5f-be27-406bdd64242b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.754531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c5048-3f37-4d5f-be27-406bdd64242b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.766233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c5048-3f37-4d5f-be27-406bdd64242b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:37.773546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-860c5048-3f37-4d5f-be27-406bdd64242b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:11:37.774845 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 60/113] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:11:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:37.776322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0c33e-0d45-4a24-9aa8-19159bfd5c4f None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.776669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0c33e-0d45-4a24-9aa8-19159bfd5c4f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.776943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0c33e-0d45-4a24-9aa8-19159bfd5c4f None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.783042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 61/114] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:37.784085 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0c33e-0d45-4a24-9aa8-19159bfd5c4f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.814476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf506e-c435-4a4d-a21e-2f269eb52ab5 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:37.866576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec7a0b-88b6-47f6-bf95-001bf90a8f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:37.867885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec7a0b-88b6-47f6-bf95-001bf90a8f1e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.868371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec7a0b-88b6-47f6-bf95-001bf90a8f1e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.868864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec7a0b-88b6-47f6-bf95-001bf90a8f1e None admin] PATH_INFO: `/v3/users/d41bad7e741e4a33ae9740b97e36ab4f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.883891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec7a0b-88b6-47f6-bf95-001bf90a8f1e None admin] RBAC: Authorizing `identity:get_user(user_id=d41bad7e741e4a33ae9740b97e36ab4f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:37.885714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec7a0b-88b6-47f6-bf95-001bf90a8f1e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:37.887836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 54/115] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:37 2022] GET /identity/v3/users/d41bad7e741e4a33ae9740b97e36ab4f => generated 289 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:37.888901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec7a0b-88b6-47f6-bf95-001bf90a8f1e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:37.906760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0c33e-0d45-4a24-9aa8-19159bfd5c4f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:37.944765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb67de4-cc39-486a-8434-9b76a8af2218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:37.945930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb67de4-cc39-486a-8434-9b76a8af2218 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.946513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb67de4-cc39-486a-8434-9b76a8af2218 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.947036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb67de4-cc39-486a-8434-9b76a8af2218 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.958604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb67de4-cc39-486a-8434-9b76a8af2218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:37.966978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-6cb67de4-cc39-486a-8434-9b76a8af2218 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:11:37.968556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 62/116] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:11:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:37.974470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16930a7f-5f7b-423f-ac33-66274053259f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:37.975052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16930a7f-5f7b-423f-ac33-66274053259f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:37.975575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16930a7f-5f7b-423f-ac33-66274053259f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:37.993334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-16930a7f-5f7b-423f-ac33-66274053259f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:37.995137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-16930a7f-5f7b-423f-ac33-66274053259f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:38.009631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec7a0b-88b6-47f6-bf95-001bf90a8f1e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.052407 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c08b7-dad3-4e9a-8880-e999602480d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.053084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c08b7-dad3-4e9a-8880-e999602480d5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.053374 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c08b7-dad3-4e9a-8880-e999602480d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.053656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c08b7-dad3-4e9a-8880-e999602480d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.056599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c08b7-dad3-4e9a-8880-e999602480d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:38.056919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c08b7-dad3-4e9a-8880-e999602480d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.058922 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c08b7-dad3-4e9a-8880-e999602480d5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.068597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 63/117] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:38.069787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16930a7f-5f7b-423f-ac33-66274053259f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.075654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 55/118] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:38.078726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c08b7-dad3-4e9a-8880-e999602480d5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.183138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16930a7f-5f7b-423f-ac33-66274053259f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.206387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c08b7-dad3-4e9a-8880-e999602480d5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.220236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d098b-3778-46b7-810d-bc6de557dc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.220901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d098b-3778-46b7-810d-bc6de557dc48 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.221197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d098b-3778-46b7-810d-bc6de557dc48 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.221476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d098b-3778-46b7-810d-bc6de557dc48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.246057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb810c-7056-4555-b5e1-297fb678966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.246769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb810c-7056-4555-b5e1-297fb678966f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.247059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb810c-7056-4555-b5e1-297fb678966f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.247347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb810c-7056-4555-b5e1-297fb678966f None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.248631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb810c-7056-4555-b5e1-297fb678966f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:38.248946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb810c-7056-4555-b5e1-297fb678966f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.250808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb810c-7056-4555-b5e1-297fb678966f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.259327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 56/119] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:38.260119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb810c-7056-4555-b5e1-297fb678966f None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.299639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d098b-3778-46b7-810d-bc6de557dc48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.301110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d098b-3778-46b7-810d-bc6de557dc48 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.360605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb810c-7056-4555-b5e1-297fb678966f None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.395227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5137b-ad46-46e1-8245-ec9cd2900d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.396117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5137b-ad46-46e1-8245-ec9cd2900d87 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.396417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5137b-ad46-46e1-8245-ec9cd2900d87 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.396682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5137b-ad46-46e1-8245-ec9cd2900d87 None admin] PATH_INFO: `/v3/users/674ef23c54a243f3842909c6f536a72a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.397875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5137b-ad46-46e1-8245-ec9cd2900d87 None admin] RBAC: Authorizing `identity:get_user(user_id=674ef23c54a243f3842909c6f536a72a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.399352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5137b-ad46-46e1-8245-ec9cd2900d87 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.405831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 64/120] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:38.405986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 57/121] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/users/674ef23c54a243f3842909c6f536a72a => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:38.406064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d098b-3778-46b7-810d-bc6de557dc48 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.406133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8744fb2-a8a7-421a-8cf3-7be86dabbe2c None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.406133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8744fb2-a8a7-421a-8cf3-7be86dabbe2c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.406133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8744fb2-a8a7-421a-8cf3-7be86dabbe2c None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.406133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 58/122] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:38.406133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8744fb2-a8a7-421a-8cf3-7be86dabbe2c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.507270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d098b-3778-46b7-810d-bc6de557dc48 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.508716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8744fb2-a8a7-421a-8cf3-7be86dabbe2c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.540328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14825e60-ab12-40c9-9d31-afa0d9f1d616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.541125 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14825e60-ab12-40c9-9d31-afa0d9f1d616 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.541401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14825e60-ab12-40c9-9d31-afa0d9f1d616 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.541677 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14825e60-ab12-40c9-9d31-afa0d9f1d616 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.542353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47f327-5550-4c15-b5cc-192b87ebe02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.542864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14825e60-ab12-40c9-9d31-afa0d9f1d616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.543242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47f327-5550-4c15-b5cc-192b87ebe02a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.543552 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47f327-5550-4c15-b5cc-192b87ebe02a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.543859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47f327-5550-4c15-b5cc-192b87ebe02a None admin] PATH_INFO: `/v3/users/f75b0fefc7e946f3a9e33757e996c8eb` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.544301 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14825e60-ab12-40c9-9d31-afa0d9f1d616 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.545146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47f327-5550-4c15-b5cc-192b87ebe02a None admin] RBAC: Authorizing `identity:get_user(user_id=f75b0fefc7e946f3a9e33757e996c8eb)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.554676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 65/123] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:38.555153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47f327-5550-4c15-b5cc-192b87ebe02a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.555505 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14825e60-ab12-40c9-9d31-afa0d9f1d616 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.555590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 59/124] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/users/f75b0fefc7e946f3a9e33757e996c8eb => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:38.555590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d60f8-819c-4c4c-bc88-4128def7d59f None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.555590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d60f8-819c-4c4c-bc88-4128def7d59f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.555590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d60f8-819c-4c4c-bc88-4128def7d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.571212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-be4d60f8-819c-4c4c-bc88-4128def7d59f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:38.572471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-be4d60f8-819c-4c4c-bc88-4128def7d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:38.642335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 60/125] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:38.642335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d60f8-819c-4c4c-bc88-4128def7d59f None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.670592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14825e60-ab12-40c9-9d31-afa0d9f1d616 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.705246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d4a89-b858-454d-a2cc-444f162fa87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.706146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d4a89-b858-454d-a2cc-444f162fa87d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.706500 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d4a89-b858-454d-a2cc-444f162fa87d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.706778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d4a89-b858-454d-a2cc-444f162fa87d None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.707998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d4a89-b858-454d-a2cc-444f162fa87d None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.709559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d4a89-b858-454d-a2cc-444f162fa87d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.711589 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 66/126] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:38.712285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d4a89-b858-454d-a2cc-444f162fa87d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.753507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d60f8-819c-4c4c-bc88-4128def7d59f None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.787414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bc3ed-a4e9-4fef-9bf4-92a2998e11b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.788279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bc3ed-a4e9-4fef-9bf4-92a2998e11b9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.788559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bc3ed-a4e9-4fef-9bf4-92a2998e11b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.788831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bc3ed-a4e9-4fef-9bf4-92a2998e11b9 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.790287 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bc3ed-a4e9-4fef-9bf4-92a2998e11b9 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.791768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052bc3ed-a4e9-4fef-9bf4-92a2998e11b9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.793439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 61/127] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:38.794169 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bc3ed-a4e9-4fef-9bf4-92a2998e11b9 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.826866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d4a89-b858-454d-a2cc-444f162fa87d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.860358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c084ee7-f7ff-4891-98ed-18d16ea7f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.861350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084ee7-f7ff-4891-98ed-18d16ea7f8ba None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.861677 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084ee7-f7ff-4891-98ed-18d16ea7f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.861965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c084ee7-f7ff-4891-98ed-18d16ea7f8ba None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.863209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c084ee7-f7ff-4891-98ed-18d16ea7f8ba None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.864652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c084ee7-f7ff-4891-98ed-18d16ea7f8ba None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.866538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 67/128] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:38.871604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c084ee7-f7ff-4891-98ed-18d16ea7f8ba None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.898065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bc3ed-a4e9-4fef-9bf4-92a2998e11b9 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:38.934696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7650f2-24bc-4dd8-9c51-730b3be96bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:38.935376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7650f2-24bc-4dd8-9c51-730b3be96bc2 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:38.935662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7650f2-24bc-4dd8-9c51-730b3be96bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:38.935943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7650f2-24bc-4dd8-9c51-730b3be96bc2 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:38.936643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7650f2-24bc-4dd8-9c51-730b3be96bc2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:38.938078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7650f2-24bc-4dd8-9c51-730b3be96bc2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:38.962913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 62/129] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:11:38 2022] POST /identity/v3/projects => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:38.963908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7650f2-24bc-4dd8-9c51-730b3be96bc2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:38.983020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c084ee7-f7ff-4891-98ed-18d16ea7f8ba None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:39.021020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470b0a-9b33-45ca-b61b-b90f8b926439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:39.021994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470b0a-9b33-45ca-b61b-b90f8b926439 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.022395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470b0a-9b33-45ca-b61b-b90f8b926439 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.022820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470b0a-9b33-45ca-b61b-b90f8b926439 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.034986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6470b0a-9b33-45ca-b61b-b90f8b926439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:39.042559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-d6470b0a-9b33-45ca-b61b-b90f8b926439 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:11:39.048996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 68/130] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:39.050036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470b0a-9b33-45ca-b61b-b90f8b926439 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:39.106793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7650f2-24bc-4dd8-9c51-730b3be96bc2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:39.161051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470b0a-9b33-45ca-b61b-b90f8b926439 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:39.162244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e1155-ac2b-4438-8a48-8f260c98709d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:39.163160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1155-ac2b-4438-8a48-8f260c98709d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.163627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1155-ac2b-4438-8a48-8f260c98709d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.164106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1155-ac2b-4438-8a48-8f260c98709d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.165394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1155-ac2b-4438-8a48-8f260c98709d None admin] RBAC: Adding query filter params (role.id=b7c28e17253a4f69a6341e791c4c75df, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c, user.id=d41bad7e741e4a33ae9740b97e36ab4f) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:39.165891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1155-ac2b-4438-8a48-8f260c98709d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:39.167648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1155-ac2b-4438-8a48-8f260c98709d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:39.175499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 63/131] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:38 2022] GET /identity/v3/role_assignments?user.id=d41bad7e741e4a33ae9740b97e36ab4f&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=b7c28e17253a4f69a6341e791c4c75df => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:39.176642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e1155-ac2b-4438-8a48-8f260c98709d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:39.218452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33a2a-973b-4d1e-8413-59774b100f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:39.219736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33a2a-973b-4d1e-8413-59774b100f8f None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.220254 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33a2a-973b-4d1e-8413-59774b100f8f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.220745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca33a2a-973b-4d1e-8413-59774b100f8f None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/users/674ef23c54a243f3842909c6f536a72a/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.223204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca33a2a-973b-4d1e-8413-59774b100f8f None admin] RBAC: Authorizing `identity:create_grant(project_id=81d9b125a65a40ef8faf3f1791912d0c, user_id=674ef23c54a243f3842909c6f536a72a, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:39.224932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca33a2a-973b-4d1e-8413-59774b100f8f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:39.248972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 69/132] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:11:39 2022] PUT /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/users/674ef23c54a243f3842909c6f536a72a/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:39.251344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33a2a-973b-4d1e-8413-59774b100f8f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:39.313247 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e1155-ac2b-4438-8a48-8f260c98709d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:39.368777 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ffb7-67cf-4047-aa4f-58026f01f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:39.369747 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ffb7-67cf-4047-aa4f-58026f01f250 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.370038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ffb7-67cf-4047-aa4f-58026f01f250 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.370357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7ffb7-67cf-4047-aa4f-58026f01f250 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/users/f75b0fefc7e946f3a9e33757e996c8eb/roles/3950e5fe56724635b0bd65e6d20fcd1d` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.372658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7ffb7-67cf-4047-aa4f-58026f01f250 None admin] RBAC: Authorizing `identity:create_grant(project_id=81d9b125a65a40ef8faf3f1791912d0c, user_id=f75b0fefc7e946f3a9e33757e996c8eb, role_id=3950e5fe56724635b0bd65e6d20fcd1d)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:39.374739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7ffb7-67cf-4047-aa4f-58026f01f250 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:39.391754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca33a2a-973b-4d1e-8413-59774b100f8f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:39.396875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 64/133] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:11:39 2022] PUT /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/users/f75b0fefc7e946f3a9e33757e996c8eb/roles/3950e5fe56724635b0bd65e6d20fcd1d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:39.434743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de146dc-a48e-4e1c-90db-b98c3fb84ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:39.436471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de146dc-a48e-4e1c-90db-b98c3fb84ac2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.436983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de146dc-a48e-4e1c-90db-b98c3fb84ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.437461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de146dc-a48e-4e1c-90db-b98c3fb84ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.438515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de146dc-a48e-4e1c-90db-b98c3fb84ac2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:39.439014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de146dc-a48e-4e1c-90db-b98c3fb84ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:39.440741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de146dc-a48e-4e1c-90db-b98c3fb84ac2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:39.451804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 70/134] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:39.459341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ffb7-67cf-4047-aa4f-58026f01f250 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:39.602591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7ffb7-67cf-4047-aa4f-58026f01f250 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:39.641915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91981dae-ffee-4221-a3ef-f4f84df9f614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:39.642852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91981dae-ffee-4221-a3ef-f4f84df9f614 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.643144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91981dae-ffee-4221-a3ef-f4f84df9f614 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.643424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91981dae-ffee-4221-a3ef-f4f84df9f614 None admin] PATH_INFO: `/v3/users/f75b0fefc7e946f3a9e33757e996c8eb` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.644675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91981dae-ffee-4221-a3ef-f4f84df9f614 None admin] RBAC: Authorizing `identity:get_user(user_id=f75b0fefc7e946f3a9e33757e996c8eb)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:39.646134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91981dae-ffee-4221-a3ef-f4f84df9f614 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:39.648169 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 65/135] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:39 2022] GET /identity/v3/users/f75b0fefc7e946f3a9e33757e996c8eb => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:39.653695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de146dc-a48e-4e1c-90db-b98c3fb84ac2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:39.759497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de146dc-a48e-4e1c-90db-b98c3fb84ac2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:39.794058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16604f-8796-4b18-8edd-80f4cc103110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:39.795033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16604f-8796-4b18-8edd-80f4cc103110 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.795318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16604f-8796-4b18-8edd-80f4cc103110 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.795594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16604f-8796-4b18-8edd-80f4cc103110 None admin] PATH_INFO: `/v3/projects/f9ae6399b4224e7ebe92f8bad4da7fb6` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.796804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16604f-8796-4b18-8edd-80f4cc103110 None admin] RBAC: Authorizing `identity:get_project(project_id=f9ae6399b4224e7ebe92f8bad4da7fb6)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:39.798244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16604f-8796-4b18-8edd-80f4cc103110 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:39.800271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 71/136] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:39 2022] GET /identity/v3/projects/f9ae6399b4224e7ebe92f8bad4da7fb6 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:39.805836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91981dae-ffee-4221-a3ef-f4f84df9f614 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:39.907126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91981dae-ffee-4221-a3ef-f4f84df9f614 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:39.940601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87788bd-ce6e-43f1-aeb1-15271a990086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:39.941502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87788bd-ce6e-43f1-aeb1-15271a990086 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.941789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87788bd-ce6e-43f1-aeb1-15271a990086 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.942072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87788bd-ce6e-43f1-aeb1-15271a990086 None admin] PATH_INFO: `/v3/projects/f9ae6399b4224e7ebe92f8bad4da7fb6/users/f75b0fefc7e946f3a9e33757e996c8eb/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.944125 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87788bd-ce6e-43f1-aeb1-15271a990086 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9ae6399b4224e7ebe92f8bad4da7fb6, user_id=f75b0fefc7e946f3a9e33757e996c8eb, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:39.945567 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87788bd-ce6e-43f1-aeb1-15271a990086 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:39.962272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 66/137] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:11:39 2022] PUT /identity/v3/projects/f9ae6399b4224e7ebe92f8bad4da7fb6/users/f75b0fefc7e946f3a9e33757e996c8eb/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:40.214067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2c08-6641-4a04-ae77-914463b1b1df None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:40.214457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2c08-6641-4a04-ae77-914463b1b1df None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:40.214688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb2c08-6641-4a04-ae77-914463b1b1df None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:40.216329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 72/138] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:40.221844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19611408-ed37-4171-ab0d-e74fb2b5009b None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:40.222145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19611408-ed37-4171-ab0d-e74fb2b5009b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:40.222460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19611408-ed37-4171-ab0d-e74fb2b5009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:40.243380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-19611408-ed37-4171-ab0d-e74fb2b5009b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:40.244602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-19611408-ed37-4171-ab0d-e74fb2b5009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:40.332837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 67/139] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:40.371760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb2c08-6641-4a04-ae77-914463b1b1df None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:40.495952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb2c08-6641-4a04-ae77-914463b1b1df None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:40.533634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb4bfa-0a32-477a-915f-5a9246dbff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:40.534473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb4bfa-0a32-477a-915f-5a9246dbff9d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:40.534762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb4bfa-0a32-477a-915f-5a9246dbff9d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:40.535041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb4bfa-0a32-477a-915f-5a9246dbff9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:40.546441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb4bfa-0a32-477a-915f-5a9246dbff9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:40.553448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2dfb4bfa-0a32-477a-915f-5a9246dbff9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:11:40.554687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 73/140] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:40.562481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19611408-ed37-4171-ab0d-e74fb2b5009b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:40.662032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19611408-ed37-4171-ab0d-e74fb2b5009b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:40.696152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f35b-b03e-44c4-b41c-fd8b2e936315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:40.696839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f35b-b03e-44c4-b41c-fd8b2e936315 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:40.697124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f35b-b03e-44c4-b41c-fd8b2e936315 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:40.697401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997f35b-b03e-44c4-b41c-fd8b2e936315 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:40.698164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997f35b-b03e-44c4-b41c-fd8b2e936315 None admin] RBAC: Adding query filter params (name=member) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:40.698500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997f35b-b03e-44c4-b41c-fd8b2e936315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:40.699882 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997f35b-b03e-44c4-b41c-fd8b2e936315 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:40.708660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 68/141] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:40.714140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb4bfa-0a32-477a-915f-5a9246dbff9d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:40.814532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb4bfa-0a32-477a-915f-5a9246dbff9d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:40.847730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5e55-a84b-4bc8-a2f7-0e45d655b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:40.848613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5e55-a84b-4bc8-a2f7-0e45d655b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:40.848904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5e55-a84b-4bc8-a2f7-0e45d655b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:40.849182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5e55-a84b-4bc8-a2f7-0e45d655b0d6 None admin] PATH_INFO: `/v3/users/f75b0fefc7e946f3a9e33757e996c8eb` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:40.850426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5e55-a84b-4bc8-a2f7-0e45d655b0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=f75b0fefc7e946f3a9e33757e996c8eb)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:40.851892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5e55-a84b-4bc8-a2f7-0e45d655b0d6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:40.853698 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 74/142] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:40 2022] GET /identity/v3/users/f75b0fefc7e946f3a9e33757e996c8eb => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:40.859109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f35b-b03e-44c4-b41c-fd8b2e936315 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:40.959909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997f35b-b03e-44c4-b41c-fd8b2e936315 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:40.994003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a568493-5f23-4cea-af29-850017d10bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:40.994716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a568493-5f23-4cea-af29-850017d10bbb None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:40.995004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a568493-5f23-4cea-af29-850017d10bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:40.995283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a568493-5f23-4cea-af29-850017d10bbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:41.065851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a568493-5f23-4cea-af29-850017d10bbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:41.067260 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a568493-5f23-4cea-af29-850017d10bbb None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:41.165926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 69/143] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:41.171422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5e55-a84b-4bc8-a2f7-0e45d655b0d6 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:41.274036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5e55-a84b-4bc8-a2f7-0e45d655b0d6 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:41.313296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85dae3-497c-4cff-8056-acffd20fdd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:41.314172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85dae3-497c-4cff-8056-acffd20fdd92 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:41.314483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85dae3-497c-4cff-8056-acffd20fdd92 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:41.314767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85dae3-497c-4cff-8056-acffd20fdd92 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:41.316020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85dae3-497c-4cff-8056-acffd20fdd92 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:41.317414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85dae3-497c-4cff-8056-acffd20fdd92 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:41.319408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 75/144] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:41 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:41.325041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a568493-5f23-4cea-af29-850017d10bbb None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:41.430739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a568493-5f23-4cea-af29-850017d10bbb None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:41.469911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56968151-a0ec-4d5a-97a5-27b83a7d5f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:41.470613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968151-a0ec-4d5a-97a5-27b83a7d5f29 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:41.470902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968151-a0ec-4d5a-97a5-27b83a7d5f29 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:41.471183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968151-a0ec-4d5a-97a5-27b83a7d5f29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:41.472017 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56968151-a0ec-4d5a-97a5-27b83a7d5f29 None admin] RBAC: Adding query filter params (role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c, user.id=f75b0fefc7e946f3a9e33757e996c8eb) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:41.472335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56968151-a0ec-4d5a-97a5-27b83a7d5f29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:41.473783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56968151-a0ec-4d5a-97a5-27b83a7d5f29 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:41.480058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 70/145] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:41 2022] GET /identity/v3/role_assignments?user.id=f75b0fefc7e946f3a9e33757e996c8eb&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:42.758116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfd1b5-c5f2-43dc-8eec-c76517c9a357 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:42.758673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfd1b5-c5f2-43dc-8eec-c76517c9a357 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:42.758748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfd1b5-c5f2-43dc-8eec-c76517c9a357 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:42.760203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 76/146] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:42.765959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0a3a-7140-419f-bbdc-22f392142205 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:42.766408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0a3a-7140-419f-bbdc-22f392142205 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:42.766576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb0a3a-7140-419f-bbdc-22f392142205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:42.775448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e527f2d-2112-448a-bb07-172bac7ed3d8 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:42.775744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e527f2d-2112-448a-bb07-172bac7ed3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:42.776030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e527f2d-2112-448a-bb07-172bac7ed3d8 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:42.777683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 77/147] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:42.783579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd7af3-4ef4-44ae-b536-94650edf4f44 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:42.783915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd7af3-4ef4-44ae-b536-94650edf4f44 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:42.784211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-4dbb0a3a-7140-419f-bbdc-22f392142205 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:42.784319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd7af3-4ef4-44ae-b536-94650edf4f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:42.785391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4dbb0a3a-7140-419f-bbdc-22f392142205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:42.819369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f5bd7af3-4ef4-44ae-b536-94650edf4f44 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:42.820701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f5bd7af3-4ef4-44ae-b536-94650edf4f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:42.856310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 71/148] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:42.882041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb0a3a-7140-419f-bbdc-22f392142205 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:42.940242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 78/149] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:42.942795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a29910-1881-43e8-b6c1-ceb64a244b44 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:42.943292 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a29910-1881-43e8-b6c1-ceb64a244b44 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:42.943769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a29910-1881-43e8-b6c1-ceb64a244b44 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:42.945522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 79/150] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:42.946826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69763a8b-c6fe-48d0-ab40-a2c8911e660d None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:42.947327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69763a8b-c6fe-48d0-ab40-a2c8911e660d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:42.952220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69763a8b-c6fe-48d0-ab40-a2c8911e660d None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:42.953805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 80/151] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:42.955169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d2de8-a364-48da-925d-d760b07d6d86 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:42.955679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d2de8-a364-48da-925d-d760b07d6d86 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:42.956158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d2de8-a364-48da-925d-d760b07d6d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:42.978002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-503d2de8-a364-48da-925d-d760b07d6d86 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:42.979285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-503d2de8-a364-48da-925d-d760b07d6d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:42.992394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb0a3a-7140-419f-bbdc-22f392142205 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.028179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa0598-4f6a-4332-8b6f-a2de6f69096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.029344 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa0598-4f6a-4332-8b6f-a2de6f69096e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.029821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa0598-4f6a-4332-8b6f-a2de6f69096e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.030350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa0598-4f6a-4332-8b6f-a2de6f69096e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.040936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa0598-4f6a-4332-8b6f-a2de6f69096e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:43.053929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 81/152] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:43.053929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0187452-1bbd-4cad-b87b-f6c89200d5e0 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.054137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-72aa0598-4f6a-4332-8b6f-a2de6f69096e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:11:43.054208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0187452-1bbd-4cad-b87b-f6c89200d5e0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.054208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0187452-1bbd-4cad-b87b-f6c89200d5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.054382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 72/153] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:11:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:43.054382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa0598-4f6a-4332-8b6f-a2de6f69096e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.079587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e0187452-1bbd-4cad-b87b-f6c89200d5e0 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:43.080916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e0187452-1bbd-4cad-b87b-f6c89200d5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:43.145445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 82/154] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:43.146509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0187452-1bbd-4cad-b87b-f6c89200d5e0 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.156798 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa0598-4f6a-4332-8b6f-a2de6f69096e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.191024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9e21b-8e58-40fe-9dc7-6fceb682abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.191872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9e21b-8e58-40fe-9dc7-6fceb682abb1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.192163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9e21b-8e58-40fe-9dc7-6fceb682abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.192438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9e21b-8e58-40fe-9dc7-6fceb682abb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.202946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9e21b-8e58-40fe-9dc7-6fceb682abb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:43.210220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-e4e9e21b-8e58-40fe-9dc7-6fceb682abb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:11:43.211456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 73/155] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:43.213449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9e21b-8e58-40fe-9dc7-6fceb682abb1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.258480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0187452-1bbd-4cad-b87b-f6c89200d5e0 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.292397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde2996-08d4-47da-bc46-02f2487e6a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.293079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde2996-08d4-47da-bc46-02f2487e6a0d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.293373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde2996-08d4-47da-bc46-02f2487e6a0d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.293655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde2996-08d4-47da-bc46-02f2487e6a0d None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.294472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde2996-08d4-47da-bc46-02f2487e6a0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:43.294787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde2996-08d4-47da-bc46-02f2487e6a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:43.296184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde2996-08d4-47da-bc46-02f2487e6a0d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:43.305018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 83/156] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:43.310690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde2996-08d4-47da-bc46-02f2487e6a0d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.318841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9e21b-8e58-40fe-9dc7-6fceb682abb1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.351620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb253a0-67ec-4adc-8583-046cfa070b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.352417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb253a0-67ec-4adc-8583-046cfa070b6d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.352701 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb253a0-67ec-4adc-8583-046cfa070b6d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.352974 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb253a0-67ec-4adc-8583-046cfa070b6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.363262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb253a0-67ec-4adc-8583-046cfa070b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:43.370103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-3bb253a0-67ec-4adc-8583-046cfa070b6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 00:11:43.371339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 74/157] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:43.373745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb253a0-67ec-4adc-8583-046cfa070b6d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.405227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde2996-08d4-47da-bc46-02f2487e6a0d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.437735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc7f46-08e0-414b-8054-422480fa63de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.438560 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc7f46-08e0-414b-8054-422480fa63de None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.438865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc7f46-08e0-414b-8054-422480fa63de None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.439139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc7f46-08e0-414b-8054-422480fa63de None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.440297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc7f46-08e0-414b-8054-422480fa63de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:43.442138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc7f46-08e0-414b-8054-422480fa63de None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:43.443363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 84/158] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:43.445183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc7f46-08e0-414b-8054-422480fa63de None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.473774 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb253a0-67ec-4adc-8583-046cfa070b6d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.505683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a114e-20ff-490f-b2d1-efc089e18111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.506377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a114e-20ff-490f-b2d1-efc089e18111 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.506665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a114e-20ff-490f-b2d1-efc089e18111 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.506939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a114e-20ff-490f-b2d1-efc089e18111 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.507717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a114e-20ff-490f-b2d1-efc089e18111 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:43.508024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a114e-20ff-490f-b2d1-efc089e18111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:43.509423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a114e-20ff-490f-b2d1-efc089e18111 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:43.516936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 75/159] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:43.518136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1da587-cc09-4393-927c-3563879f00d1 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.518457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1da587-cc09-4393-927c-3563879f00d1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.518740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1da587-cc09-4393-927c-3563879f00d1 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.521611 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 76/160] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:43.521611 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1da587-cc09-4393-927c-3563879f00d1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.537452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc7f46-08e0-414b-8054-422480fa63de None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.569686 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d81af-f2f8-42fb-8a12-2ed2dab44242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.570579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d81af-f2f8-42fb-8a12-2ed2dab44242 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.570864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d81af-f2f8-42fb-8a12-2ed2dab44242 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.571136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d81af-f2f8-42fb-8a12-2ed2dab44242 None admin] PATH_INFO: `/v3/users/674ef23c54a243f3842909c6f536a72a` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.572310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d81af-f2f8-42fb-8a12-2ed2dab44242 None admin] RBAC: Authorizing `identity:get_user(user_id=674ef23c54a243f3842909c6f536a72a)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:43.573739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d81af-f2f8-42fb-8a12-2ed2dab44242 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:43.575390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 85/161] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/users/674ef23c54a243f3842909c6f536a72a => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:43.579934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d81af-f2f8-42fb-8a12-2ed2dab44242 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.616220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1da587-cc09-4393-927c-3563879f00d1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.647132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c29e-281f-4b0f-b1a1-854dffb621f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.647793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c29e-281f-4b0f-b1a1-854dffb621f0 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.648078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c29e-281f-4b0f-b1a1-854dffb621f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.648346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6c29e-281f-4b0f-b1a1-854dffb621f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.649079 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c29e-281f-4b0f-b1a1-854dffb621f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:43.649376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c29e-281f-4b0f-b1a1-854dffb621f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:43.650780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6c29e-281f-4b0f-b1a1-854dffb621f0 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:43.661033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 77/162] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:43.661033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c29e-281f-4b0f-b1a1-854dffb621f0 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.670672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d81af-f2f8-42fb-8a12-2ed2dab44242 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.703259 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cb88d-fb88-4b9c-a373-668c4a6d0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.703946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cb88d-fb88-4b9c-a373-668c4a6d0c8f None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.704233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cb88d-fb88-4b9c-a373-668c4a6d0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.704507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cb88d-fb88-4b9c-a373-668c4a6d0c8f None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.705205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cb88d-fb88-4b9c-a373-668c4a6d0c8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:43.706661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cb88d-fb88-4b9c-a373-668c4a6d0c8f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:43.724502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 86/163] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:11:43 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:43.725890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057aaf-2885-4668-a185-7b8f8d4d12cc None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.726178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057aaf-2885-4668-a185-7b8f8d4d12cc None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.726519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c057aaf-2885-4668-a185-7b8f8d4d12cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.744213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3c057aaf-2885-4668-a185-7b8f8d4d12cc None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:43.745435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3c057aaf-2885-4668-a185-7b8f8d4d12cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:43.773864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6c29e-281f-4b0f-b1a1-854dffb621f0 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.811369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a948d7-1fc3-4c96-9450-980d7d99bd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.812270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a948d7-1fc3-4c96-9450-980d7d99bd0c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.812550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a948d7-1fc3-4c96-9450-980d7d99bd0c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.812823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a948d7-1fc3-4c96-9450-980d7d99bd0c None admin] PATH_INFO: `/v3/users/f75b0fefc7e946f3a9e33757e996c8eb` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.814067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a948d7-1fc3-4c96-9450-980d7d99bd0c None admin] RBAC: Authorizing `identity:get_user(user_id=f75b0fefc7e946f3a9e33757e996c8eb)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:43.815848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a948d7-1fc3-4c96-9450-980d7d99bd0c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:43.815969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 87/164] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:43.817555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 78/165] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/users/f75b0fefc7e946f3a9e33757e996c8eb => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:43.819358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057aaf-2885-4668-a185-7b8f8d4d12cc None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.823178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a948d7-1fc3-4c96-9450-980d7d99bd0c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:43.924350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a948d7-1fc3-4c96-9450-980d7d99bd0c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.925107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c057aaf-2885-4668-a185-7b8f8d4d12cc None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:43.959457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3108-fa5e-4940-b823-9b191ac87d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.959649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421bc60-a8a7-493d-904b-0c264377b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:43.960224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421bc60-a8a7-493d-904b-0c264377b283 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.960352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3108-fa5e-4940-b823-9b191ac87d9e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:43.960521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421bc60-a8a7-493d-904b-0c264377b283 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.960627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3108-fa5e-4940-b823-9b191ac87d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:43.960788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421bc60-a8a7-493d-904b-0c264377b283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.960878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b3108-fa5e-4940-b823-9b191ac87d9e None admin] PATH_INFO: `/v3/users/d41bad7e741e4a33ae9740b97e36ab4f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:43.961981 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3108-fa5e-4940-b823-9b191ac87d9e None admin] RBAC: Authorizing `identity:get_user(user_id=d41bad7e741e4a33ae9740b97e36ab4f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:43.963439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b3108-fa5e-4940-b823-9b191ac87d9e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:43.965222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 79/166] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/users/d41bad7e741e4a33ae9740b97e36ab4f => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:43.965916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3108-fa5e-4940-b823-9b191ac87d9e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:44.038001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421bc60-a8a7-493d-904b-0c264377b283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:44.039773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421bc60-a8a7-493d-904b-0c264377b283 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:44.080790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b3108-fa5e-4940-b823-9b191ac87d9e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:44.124134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea27018-da1e-4ce7-baeb-2183d9fc2071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:44.124786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea27018-da1e-4ce7-baeb-2183d9fc2071 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:44.125064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea27018-da1e-4ce7-baeb-2183d9fc2071 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:44.125335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea27018-da1e-4ce7-baeb-2183d9fc2071 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:44.147257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 88/167] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:44.148119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421bc60-a8a7-493d-904b-0c264377b283 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:44.214559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea27018-da1e-4ce7-baeb-2183d9fc2071 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:44.216008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea27018-da1e-4ce7-baeb-2183d9fc2071 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:44.257043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421bc60-a8a7-493d-904b-0c264377b283 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:44.292264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84daf55-35bd-4a0d-b2c3-b04f7ad7629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:44.293289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84daf55-35bd-4a0d-b2c3-b04f7ad7629b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:44.293574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84daf55-35bd-4a0d-b2c3-b04f7ad7629b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:44.293845 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84daf55-35bd-4a0d-b2c3-b04f7ad7629b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:44.304582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84daf55-35bd-4a0d-b2c3-b04f7ad7629b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:44.311692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-d84daf55-35bd-4a0d-b2c3-b04f7ad7629b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:11:44.313318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 89/168] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:44.314746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84daf55-35bd-4a0d-b2c3-b04f7ad7629b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:44.333995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 80/169] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:44.335161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea27018-da1e-4ce7-baeb-2183d9fc2071 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:44.417852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84daf55-35bd-4a0d-b2c3-b04f7ad7629b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:44.451813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d99a6c-8102-4818-a72f-4d19e3fd42d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:44.452678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d99a6c-8102-4818-a72f-4d19e3fd42d1 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:44.452967 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d99a6c-8102-4818-a72f-4d19e3fd42d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:44.453229 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d99a6c-8102-4818-a72f-4d19e3fd42d1 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:44.454443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d99a6c-8102-4818-a72f-4d19e3fd42d1 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:44.455888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d99a6c-8102-4818-a72f-4d19e3fd42d1 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:44.457585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 90/170] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:44 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:44.458362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d99a6c-8102-4818-a72f-4d19e3fd42d1 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:44.490534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea27018-da1e-4ce7-baeb-2183d9fc2071 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:44.555340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d99a6c-8102-4818-a72f-4d19e3fd42d1 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:44.564269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5519a7a-aaac-45a1-ba30-71b8f45e9630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:44.565441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5519a7a-aaac-45a1-ba30-71b8f45e9630 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:44.565969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5519a7a-aaac-45a1-ba30-71b8f45e9630 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:44.566464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5519a7a-aaac-45a1-ba30-71b8f45e9630 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:44.570956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5519a7a-aaac-45a1-ba30-71b8f45e9630 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:44.572634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5519a7a-aaac-45a1-ba30-71b8f45e9630 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:44.575545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 81/171] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:44 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:44.576617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5519a7a-aaac-45a1-ba30-71b8f45e9630 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:44.588829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d79495-4848-4949-832d-a88bbb484a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:44.589500 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d79495-4848-4949-832d-a88bbb484a40 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:44.589780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d79495-4848-4949-832d-a88bbb484a40 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:44.590054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d79495-4848-4949-832d-a88bbb484a40 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:44.594305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d79495-4848-4949-832d-a88bbb484a40 None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:44.594305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d79495-4848-4949-832d-a88bbb484a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:44.594305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d79495-4848-4949-832d-a88bbb484a40 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:44.601375 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 91/172] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:44.602154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d79495-4848-4949-832d-a88bbb484a40 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:44.699134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d79495-4848-4949-832d-a88bbb484a40 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:44.738390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946a5d1-7da3-46b7-a803-39f70804be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:44.738390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946a5d1-7da3-46b7-a803-39f70804be05 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:44.738390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946a5d1-7da3-46b7-a803-39f70804be05 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:44.738390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946a5d1-7da3-46b7-a803-39f70804be05 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/users/d41bad7e741e4a33ae9740b97e36ab4f/roles/b7c28e17253a4f69a6341e791c4c75df` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:44.738776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946a5d1-7da3-46b7-a803-39f70804be05 None admin] RBAC: Authorizing `identity:create_grant(project_id=81d9b125a65a40ef8faf3f1791912d0c, user_id=d41bad7e741e4a33ae9740b97e36ab4f, role_id=b7c28e17253a4f69a6341e791c4c75df)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:44.738776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946a5d1-7da3-46b7-a803-39f70804be05 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:44.751555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 92/173] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:11:44 2022] PUT /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/users/d41bad7e741e4a33ae9740b97e36ab4f/roles/b7c28e17253a4f69a6341e791c4c75df => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:44.752179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946a5d1-7da3-46b7-a803-39f70804be05 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:44.793306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5519a7a-aaac-45a1-ba30-71b8f45e9630 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:44.858966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62412338-4609-4d2f-9b5e-fd1a6c2d955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:44.859861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62412338-4609-4d2f-9b5e-fd1a6c2d955c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:44.860147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62412338-4609-4d2f-9b5e-fd1a6c2d955c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:44.860426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62412338-4609-4d2f-9b5e-fd1a6c2d955c None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:44.861744 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62412338-4609-4d2f-9b5e-fd1a6c2d955c None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:44.863272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62412338-4609-4d2f-9b5e-fd1a6c2d955c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:44.865051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946a5d1-7da3-46b7-a803-39f70804be05 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:44.865587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 82/174] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:44 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:44.866280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62412338-4609-4d2f-9b5e-fd1a6c2d955c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:44.907186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038f1ca-fc13-4a0d-a01e-eac8ce665a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:44.907923 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038f1ca-fc13-4a0d-a01e-eac8ce665a7f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:44.908213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038f1ca-fc13-4a0d-a01e-eac8ce665a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:44.908488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038f1ca-fc13-4a0d-a01e-eac8ce665a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:44.909360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038f1ca-fc13-4a0d-a01e-eac8ce665a7f None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c, user.id=674ef23c54a243f3842909c6f536a72a) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:44.909672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038f1ca-fc13-4a0d-a01e-eac8ce665a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:44.911231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038f1ca-fc13-4a0d-a01e-eac8ce665a7f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:44.926378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 93/175] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:44 2022] GET /identity/v3/role_assignments?user.id=674ef23c54a243f3842909c6f536a72a&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=f0208c43117c4b799194c83781a46e09 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:44.927300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038f1ca-fc13-4a0d-a01e-eac8ce665a7f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:45.056625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62412338-4609-4d2f-9b5e-fd1a6c2d955c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:45.058035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038f1ca-fc13-4a0d-a01e-eac8ce665a7f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:45.093082 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca6453-29c3-468e-8a13-9a3d6f3db204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:45.093744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca6453-29c3-468e-8a13-9a3d6f3db204 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:45.094023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca6453-29c3-468e-8a13-9a3d6f3db204 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:45.094320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca6453-29c3-468e-8a13-9a3d6f3db204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:45.095211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca6453-29c3-468e-8a13-9a3d6f3db204 None admin] RBAC: Adding query filter params (role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c, user.id=f75b0fefc7e946f3a9e33757e996c8eb) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:45.095518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca6453-29c3-468e-8a13-9a3d6f3db204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:45.096944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca6453-29c3-468e-8a13-9a3d6f3db204 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:45.103586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 94/176] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:44 2022] GET /identity/v3/role_assignments?user.id=f75b0fefc7e946f3a9e33757e996c8eb&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:45.116575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74413-bd33-43ef-adc9-a450e82a5f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:45.117493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74413-bd33-43ef-adc9-a450e82a5f80 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:45.117783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74413-bd33-43ef-adc9-a450e82a5f80 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:45.118064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca74413-bd33-43ef-adc9-a450e82a5f80 None admin] PATH_INFO: `/v3/users/f75b0fefc7e946f3a9e33757e996c8eb` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:45.120522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74413-bd33-43ef-adc9-a450e82a5f80 None admin] RBAC: Authorizing `identity:get_user(user_id=f75b0fefc7e946f3a9e33757e996c8eb)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:45.122026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca74413-bd33-43ef-adc9-a450e82a5f80 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:45.124233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 83/177] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:44 2022] GET /identity/v3/users/f75b0fefc7e946f3a9e33757e996c8eb => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:45.129602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca6453-29c3-468e-8a13-9a3d6f3db204 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:45.277128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca6453-29c3-468e-8a13-9a3d6f3db204 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:45.315376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995b36c-8db7-4a6f-ba77-5bd387ef7ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:45.315964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995b36c-8db7-4a6f-ba77-5bd387ef7ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:45.316245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995b36c-8db7-4a6f-ba77-5bd387ef7ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:45.316532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995b36c-8db7-4a6f-ba77-5bd387ef7ef7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:45.390143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995b36c-8db7-4a6f-ba77-5bd387ef7ef7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:45.391651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995b36c-8db7-4a6f-ba77-5bd387ef7ef7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:45.496216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 95/178] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:45.502571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74413-bd33-43ef-adc9-a450e82a5f80 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:45.612400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca74413-bd33-43ef-adc9-a450e82a5f80 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:45.647448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f826a77-d509-4030-932f-716bdc726ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:45.648317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826a77-d509-4030-932f-716bdc726ec5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:45.648595 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826a77-d509-4030-932f-716bdc726ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:45.648865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f826a77-d509-4030-932f-716bdc726ec5 None admin] PATH_INFO: `/v3/projects/f9ae6399b4224e7ebe92f8bad4da7fb6` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:45.650077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826a77-d509-4030-932f-716bdc726ec5 None admin] RBAC: Authorizing `identity:get_project(project_id=f9ae6399b4224e7ebe92f8bad4da7fb6)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:45.651564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f826a77-d509-4030-932f-716bdc726ec5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:45.653566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 84/179] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:45 2022] GET /identity/v3/projects/f9ae6399b4224e7ebe92f8bad4da7fb6 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:45.661856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995b36c-8db7-4a6f-ba77-5bd387ef7ef7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:45.798074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995b36c-8db7-4a6f-ba77-5bd387ef7ef7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:45.849429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f711f0-05f1-4dfa-9333-b3d3b0e872e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:45.850099 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f711f0-05f1-4dfa-9333-b3d3b0e872e3 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:45.850405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f711f0-05f1-4dfa-9333-b3d3b0e872e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:45.850679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f711f0-05f1-4dfa-9333-b3d3b0e872e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:45.851513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f711f0-05f1-4dfa-9333-b3d3b0e872e3 None admin] RBAC: Adding query filter params (role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=f9ae6399b4224e7ebe92f8bad4da7fb6, user.id=f75b0fefc7e946f3a9e33757e996c8eb) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:45.851822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f711f0-05f1-4dfa-9333-b3d3b0e872e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:45.853270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f711f0-05f1-4dfa-9333-b3d3b0e872e3 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:45.860510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 96/180] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:45 2022] GET /identity/v3/role_assignments?user.id=f75b0fefc7e946f3a9e33757e996c8eb&scope.project.id=f9ae6399b4224e7ebe92f8bad4da7fb6&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:46.693623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a62b-b918-4b80-a1d0-52471d8ef2a9 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:46.694132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a62b-b918-4b80-a1d0-52471d8ef2a9 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:46.694207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455a62b-b918-4b80-a1d0-52471d8ef2a9 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:46.695644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 85/181] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:46.701544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb07e6-9912-4bb8-826c-5a87463c71f8 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:46.702056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb07e6-9912-4bb8-826c-5a87463c71f8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:46.702163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb07e6-9912-4bb8-826c-5a87463c71f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:46.719940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0bcb07e6-9912-4bb8-826c-5a87463c71f8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:46.721157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0bcb07e6-9912-4bb8-826c-5a87463c71f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:46.790446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 97/182] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:46.815332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455a62b-b918-4b80-a1d0-52471d8ef2a9 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:46.917823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455a62b-b918-4b80-a1d0-52471d8ef2a9 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:46.952436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b672f-c90b-4135-806c-0f0f2064e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:46.953243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b672f-c90b-4135-806c-0f0f2064e5ae None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:46.953528 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b672f-c90b-4135-806c-0f0f2064e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:46.953801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b672f-c90b-4135-806c-0f0f2064e5ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:46.964389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b672f-c90b-4135-806c-0f0f2064e5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:46.972029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-a09b672f-c90b-4135-806c-0f0f2064e5ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:11:46.973627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 86/183] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:11:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:46.979418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb07e6-9912-4bb8-826c-5a87463c71f8 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:47.080169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb07e6-9912-4bb8-826c-5a87463c71f8 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:47.086469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b7c8-36ec-422b-b6b9-dc88b2d803d3 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.087035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b7c8-36ec-422b-b6b9-dc88b2d803d3 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.087510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b7c8-36ec-422b-b6b9-dc88b2d803d3 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.089084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 87/184] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:47.094852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b5503-8cb6-40ec-b7d6-67389a90966c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.095420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b5503-8cb6-40ec-b7d6-67389a90966c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.095893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b5503-8cb6-40ec-b7d6-67389a90966c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.116530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6c7b5503-8cb6-40ec-b7d6-67389a90966c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:47.116959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5748d-4e8b-4523-b8a3-b33e7a213c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:47.117632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5748d-4e8b-4523-b8a3-b33e7a213c65 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.117909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5748d-4e8b-4523-b8a3-b33e7a213c65 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.118175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5748d-4e8b-4523-b8a3-b33e7a213c65 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.118949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5748d-4e8b-4523-b8a3-b33e7a213c65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:47.119152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6c7b5503-8cb6-40ec-b7d6-67389a90966c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:47.119276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5748d-4e8b-4523-b8a3-b33e7a213c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:47.120592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5748d-4e8b-4523-b8a3-b33e7a213c65 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:47.129543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 98/185] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:47.134987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5748d-4e8b-4523-b8a3-b33e7a213c65 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:47.207660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 88/186] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:11:47.232013 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b5503-8cb6-40ec-b7d6-67389a90966c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:47.244464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5748d-4e8b-4523-b8a3-b33e7a213c65 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:47.287140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb41e5f-b0b9-4802-86f6-5963d9379700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:47.288994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41e5f-b0b9-4802-86f6-5963d9379700 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.289489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41e5f-b0b9-4802-86f6-5963d9379700 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.290367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb41e5f-b0b9-4802-86f6-5963d9379700 None admin] PATH_INFO: `/v3/users/82a6f1e59fb3452a923113775160336f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.311156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb41e5f-b0b9-4802-86f6-5963d9379700 None admin] RBAC: Authorizing `identity:get_user(user_id=82a6f1e59fb3452a923113775160336f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:47.313703 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb41e5f-b0b9-4802-86f6-5963d9379700 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:47.316419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 99/187] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:47 2022] GET /identity/v3/users/82a6f1e59fb3452a923113775160336f => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:47.321809 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb41e5f-b0b9-4802-86f6-5963d9379700 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:47.336972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b5503-8cb6-40ec-b7d6-67389a90966c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:47.382935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d351-c7e7-4c0a-ac4b-92d388bbfb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:47.384272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d351-c7e7-4c0a-ac4b-92d388bbfb60 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.384851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d351-c7e7-4c0a-ac4b-92d388bbfb60 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.385605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f9d351-c7e7-4c0a-ac4b-92d388bbfb60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.399231 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f9d351-c7e7-4c0a-ac4b-92d388bbfb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:47.410202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-53f9d351-c7e7-4c0a-ac4b-92d388bbfb60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:11:47.411783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 89/188] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:11:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:11:47.417476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d351-c7e7-4c0a-ac4b-92d388bbfb60 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:47.434371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb41e5f-b0b9-4802-86f6-5963d9379700 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:47.478531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c56d6-c703-4b33-807c-7c8120f9fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:47.479554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c56d6-c703-4b33-807c-7c8120f9fb56 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.480029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c56d6-c703-4b33-807c-7c8120f9fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.480626 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c56d6-c703-4b33-807c-7c8120f9fb56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.514193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f9d351-c7e7-4c0a-ac4b-92d388bbfb60 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:47.547470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77008639-e63d-4a21-8700-35440cc159a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:47.548137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77008639-e63d-4a21-8700-35440cc159a3 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.548426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77008639-e63d-4a21-8700-35440cc159a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.548679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77008639-e63d-4a21-8700-35440cc159a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.549424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77008639-e63d-4a21-8700-35440cc159a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:47.549724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77008639-e63d-4a21-8700-35440cc159a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:47.551159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77008639-e63d-4a21-8700-35440cc159a3 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:47.559280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 90/189] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:11:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:47.561077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c56d6-c703-4b33-807c-7c8120f9fb56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:47.562699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c56d6-c703-4b33-807c-7c8120f9fb56 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:47.563861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f67b26-6f43-4422-af1b-fb8f7c9961f7 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.564149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f67b26-6f43-4422-af1b-fb8f7c9961f7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.564422 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f67b26-6f43-4422-af1b-fb8f7c9961f7 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.566284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 91/190] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:47.566461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f67b26-6f43-4422-af1b-fb8f7c9961f7 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:47.669323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f67b26-6f43-4422-af1b-fb8f7c9961f7 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:47.671339 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 100/191] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 00:11:47.672440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5e7e-75e8-4476-a505-b5b2bac0711a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.672728 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5e7e-75e8-4476-a505-b5b2bac0711a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.673002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff5e7e-75e8-4476-a505-b5b2bac0711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.688837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5fff5e7e-75e8-4476-a505-b5b2bac0711a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:47.689911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5fff5e7e-75e8-4476-a505-b5b2bac0711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:47.707080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e552-2555-43c9-b2dd-f183606cb30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:47.707953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e552-2555-43c9-b2dd-f183606cb30c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.708229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e552-2555-43c9-b2dd-f183606cb30c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.708496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11e552-2555-43c9-b2dd-f183606cb30c None admin] PATH_INFO: `/v3/users/82a6f1e59fb3452a923113775160336f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.709676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e552-2555-43c9-b2dd-f183606cb30c None admin] RBAC: Authorizing `identity:get_user(user_id=82a6f1e59fb3452a923113775160336f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:47.711140 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11e552-2555-43c9-b2dd-f183606cb30c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:47.712934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 92/192] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:47 2022] GET /identity/v3/users/82a6f1e59fb3452a923113775160336f => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:47.713489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e552-2555-43c9-b2dd-f183606cb30c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:47.755858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 101/193] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:47.756606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff5e7e-75e8-4476-a505-b5b2bac0711a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:47.810686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11e552-2555-43c9-b2dd-f183606cb30c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:47.840772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a6846-234f-491b-a853-bbb314d5978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:47.842153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6846-234f-491b-a853-bbb314d5978a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.842456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6846-234f-491b-a853-bbb314d5978a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.842726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6846-234f-491b-a853-bbb314d5978a None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.843884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a6846-234f-491b-a853-bbb314d5978a None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:47.845305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a6846-234f-491b-a853-bbb314d5978a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:47.847009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 93/194] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:47 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:47.849298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56a94-117e-42bf-badb-566c884f9d7e None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.849596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56a94-117e-42bf-badb-566c884f9d7e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.849880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda56a94-117e-42bf-badb-566c884f9d7e None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.851297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 94/195] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:47.851399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff5e7e-75e8-4476-a505-b5b2bac0711a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:47.855735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda56a94-117e-42bf-badb-566c884f9d7e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:47.883245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675a7cb-aaf1-46d5-8ea5-f72a880a0ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:47.883885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675a7cb-aaf1-46d5-8ea5-f72a880a0ba3 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.884328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675a7cb-aaf1-46d5-8ea5-f72a880a0ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.884606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675a7cb-aaf1-46d5-8ea5-f72a880a0ba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.946963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675a7cb-aaf1-46d5-8ea5-f72a880a0ba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:47.948400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675a7cb-aaf1-46d5-8ea5-f72a880a0ba3 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:47.953088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda56a94-117e-42bf-badb-566c884f9d7e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:47.984054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5afaa-75da-4b85-9627-4921eb9825c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:47.984826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5afaa-75da-4b85-9627-4921eb9825c7 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:47.985108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5afaa-75da-4b85-9627-4921eb9825c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:47.985388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5afaa-75da-4b85-9627-4921eb9825c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:47.986557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5afaa-75da-4b85-9627-4921eb9825c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:47.987972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5afaa-75da-4b85-9627-4921eb9825c7 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:47.989556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 95/196] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:47.990422 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5afaa-75da-4b85-9627-4921eb9825c7 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.045283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 102/197] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:48.045283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b46f2-db2a-4efd-a65f-e722bf4c50ea None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.045283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b46f2-db2a-4efd-a65f-e722bf4c50ea None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.045283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b46f2-db2a-4efd-a65f-e722bf4c50ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.057577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c02b46f2-db2a-4efd-a65f-e722bf4c50ea None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:48.058762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c02b46f2-db2a-4efd-a65f-e722bf4c50ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:48.086996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5afaa-75da-4b85-9627-4921eb9825c7 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.117810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498366-81ae-4bfb-821f-dc822cfe18c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.118484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498366-81ae-4bfb-821f-dc822cfe18c1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.118765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498366-81ae-4bfb-821f-dc822cfe18c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.119047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498366-81ae-4bfb-821f-dc822cfe18c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.119861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498366-81ae-4bfb-821f-dc822cfe18c1 None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=82a354954d4f4effbdd82df1d17d6dff, user.id=82a6f1e59fb3452a923113775160336f) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:48.120313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 103/198] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:48.120439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498366-81ae-4bfb-821f-dc822cfe18c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:48.120906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b46f2-db2a-4efd-a65f-e722bf4c50ea None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.121807 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498366-81ae-4bfb-821f-dc822cfe18c1 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:48.127708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 96/199] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:47 2022] GET /identity/v3/role_assignments?user.id=82a6f1e59fb3452a923113775160336f&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=f0208c43117c4b799194c83781a46e09 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:48.128400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498366-81ae-4bfb-821f-dc822cfe18c1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.230999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b46f2-db2a-4efd-a65f-e722bf4c50ea None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.234380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498366-81ae-4bfb-821f-dc822cfe18c1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.267214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b5dde-c002-421e-93c0-7d0e82ff8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.267908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b5dde-c002-421e-93c0-7d0e82ff8624 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.268105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b2567-6ab6-490e-bd47-b9826b7468dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.268245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b5dde-c002-421e-93c0-7d0e82ff8624 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.268459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b5dde-c002-421e-93c0-7d0e82ff8624 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.268989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b2567-6ab6-490e-bd47-b9826b7468dc None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.269174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b5dde-c002-421e-93c0-7d0e82ff8624 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:48.269266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b2567-6ab6-490e-bd47-b9826b7468dc None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.269525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b2567-6ab6-490e-bd47-b9826b7468dc None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.270683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b5dde-c002-421e-93c0-7d0e82ff8624 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:48.270786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b2567-6ab6-490e-bd47-b9826b7468dc None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:48.272339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b2567-6ab6-490e-bd47-b9826b7468dc None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:48.274240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 97/200] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:48 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:48.276020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b2567-6ab6-490e-bd47-b9826b7468dc None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.291847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 104/201] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:11:48 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:48.292669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b5dde-c002-421e-93c0-7d0e82ff8624 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.406897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b5dde-c002-421e-93c0-7d0e82ff8624 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.412728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b2567-6ab6-490e-bd47-b9826b7468dc None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.445509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762969f2-d34d-4efc-a612-7fd90a0edf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.446473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762969f2-d34d-4efc-a612-7fd90a0edf49 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.446904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762969f2-d34d-4efc-a612-7fd90a0edf49 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.447334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762969f2-d34d-4efc-a612-7fd90a0edf49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.448190 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762969f2-d34d-4efc-a612-7fd90a0edf49 None admin] RBAC: Adding query filter params (role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=82a354954d4f4effbdd82df1d17d6dff, user.id=82a6f1e59fb3452a923113775160336f) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:48.448504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762969f2-d34d-4efc-a612-7fd90a0edf49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:48.449837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806acd0-ea2c-4d19-a7e2-8b7db1a0d6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.449973 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762969f2-d34d-4efc-a612-7fd90a0edf49 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:48.451072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806acd0-ea2c-4d19-a7e2-8b7db1a0d6bc None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.451586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806acd0-ea2c-4d19-a7e2-8b7db1a0d6bc None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.452056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806acd0-ea2c-4d19-a7e2-8b7db1a0d6bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.456621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 105/202] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:48 2022] GET /identity/v3/role_assignments?user.id=82a6f1e59fb3452a923113775160336f&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:48.467867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806acd0-ea2c-4d19-a7e2-8b7db1a0d6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:48.475587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-6806acd0-ea2c-4d19-a7e2-8b7db1a0d6bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 00:11:48.477186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 98/203] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:48.484913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762969f2-d34d-4efc-a612-7fd90a0edf49 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.595454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762969f2-d34d-4efc-a612-7fd90a0edf49 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.633838 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda3128-60c6-4344-87df-9a03598a9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.634566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda3128-60c6-4344-87df-9a03598a9f4c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.634848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda3128-60c6-4344-87df-9a03598a9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.635126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda3128-60c6-4344-87df-9a03598a9f4c None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.635889 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda3128-60c6-4344-87df-9a03598a9f4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:48.636195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda3128-60c6-4344-87df-9a03598a9f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:48.637570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda3128-60c6-4344-87df-9a03598a9f4c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:48.648358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 106/204] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:48.654857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806acd0-ea2c-4d19-a7e2-8b7db1a0d6bc None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.766157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806acd0-ea2c-4d19-a7e2-8b7db1a0d6bc None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.804839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0a7be-2c02-4c27-80b4-01ae1021410a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.805723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0a7be-2c02-4c27-80b4-01ae1021410a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.806001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0a7be-2c02-4c27-80b4-01ae1021410a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.806318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0a7be-2c02-4c27-80b4-01ae1021410a None admin] PATH_INFO: `/v3/users/d41bad7e741e4a33ae9740b97e36ab4f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.807552 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0a7be-2c02-4c27-80b4-01ae1021410a None admin] RBAC: Authorizing `identity:get_user(user_id=d41bad7e741e4a33ae9740b97e36ab4f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:48.808997 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0a7be-2c02-4c27-80b4-01ae1021410a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:48.811431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 99/205] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:48 2022] GET /identity/v3/users/d41bad7e741e4a33ae9740b97e36ab4f => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:48.816753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda3128-60c6-4344-87df-9a03598a9f4c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.917073 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda3128-60c6-4344-87df-9a03598a9f4c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.951134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f75a0-dadc-425d-adbd-b60fe715b900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.951793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f75a0-dadc-425d-adbd-b60fe715b900 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.952075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f75a0-dadc-425d-adbd-b60fe715b900 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.952350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f75a0-dadc-425d-adbd-b60fe715b900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:49.018682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f75a0-dadc-425d-adbd-b60fe715b900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:49.020130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f75a0-dadc-425d-adbd-b60fe715b900 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:49.115634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 107/206] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:49.121182 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0a7be-2c02-4c27-80b4-01ae1021410a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:49.219040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0a7be-2c02-4c27-80b4-01ae1021410a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:49.251668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949353d-1932-4204-841a-5f5761e22aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:49.252537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949353d-1932-4204-841a-5f5761e22aa8 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:49.252821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949353d-1932-4204-841a-5f5761e22aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:49.253094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949353d-1932-4204-841a-5f5761e22aa8 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:49.254293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949353d-1932-4204-841a-5f5761e22aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:49.255734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949353d-1932-4204-841a-5f5761e22aa8 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:49.257626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 100/207] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:49 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:49.263185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f75a0-dadc-425d-adbd-b60fe715b900 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:49.365741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f75a0-dadc-425d-adbd-b60fe715b900 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:49.399169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba305e-d567-4f63-bc92-a8c603adf798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:49.399834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba305e-d567-4f63-bc92-a8c603adf798 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:49.400110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba305e-d567-4f63-bc92-a8c603adf798 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:49.400384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba305e-d567-4f63-bc92-a8c603adf798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:49.401205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba305e-d567-4f63-bc92-a8c603adf798 None admin] RBAC: Adding query filter params (role.id=b7c28e17253a4f69a6341e791c4c75df, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c, user.id=d41bad7e741e4a33ae9740b97e36ab4f) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:49.401510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba305e-d567-4f63-bc92-a8c603adf798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:49.402962 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba305e-d567-4f63-bc92-a8c603adf798 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:49.409580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 108/208] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:49 2022] GET /identity/v3/role_assignments?user.id=d41bad7e741e4a33ae9740b97e36ab4f&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=b7c28e17253a4f69a6341e791c4c75df => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:50.564192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3750beb-1f33-4169-a608-0832eb3c94b4 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:50.564720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3750beb-1f33-4169-a608-0832eb3c94b4 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:50.564720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3750beb-1f33-4169-a608-0832eb3c94b4 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:50.566102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 101/209] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:50.571403 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4104901-5c7c-4a13-9494-aa2333d50357 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:50.571841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4104901-5c7c-4a13-9494-aa2333d50357 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:50.572009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4104901-5c7c-4a13-9494-aa2333d50357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:50.589163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c4104901-5c7c-4a13-9494-aa2333d50357 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:50.590646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c4104901-5c7c-4a13-9494-aa2333d50357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:50.658293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 109/210] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:50.680435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3750beb-1f33-4169-a608-0832eb3c94b4 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:50.790924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3750beb-1f33-4169-a608-0832eb3c94b4 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:50.824266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656e725-1ca2-4ccc-8e0e-af5aa21f6396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:50.825339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656e725-1ca2-4ccc-8e0e-af5aa21f6396 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:50.826529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656e725-1ca2-4ccc-8e0e-af5aa21f6396 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:50.826973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656e725-1ca2-4ccc-8e0e-af5aa21f6396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:50.837363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656e725-1ca2-4ccc-8e0e-af5aa21f6396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:50.844470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-7656e725-1ca2-4ccc-8e0e-af5aa21f6396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:11:50.846156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 102/211] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:50.852117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4104901-5c7c-4a13-9494-aa2333d50357 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:50.954469 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4104901-5c7c-4a13-9494-aa2333d50357 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:50.988404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f5f7a-313c-42a8-9dfc-b651e0427709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:50.989366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f5f7a-313c-42a8-9dfc-b651e0427709 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:50.989817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f5f7a-313c-42a8-9dfc-b651e0427709 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:50.990311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f5f7a-313c-42a8-9dfc-b651e0427709 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:50.991228 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f5f7a-313c-42a8-9dfc-b651e0427709 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:50.991698 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f5f7a-313c-42a8-9dfc-b651e0427709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:50.993221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f5f7a-313c-42a8-9dfc-b651e0427709 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.002123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 110/212] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:51.009213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656e725-1ca2-4ccc-8e0e-af5aa21f6396 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.085243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c550fb9-25b3-4b6c-96f5-1073984e9bcc None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.085479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c550fb9-25b3-4b6c-96f5-1073984e9bcc None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.085718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c550fb9-25b3-4b6c-96f5-1073984e9bcc None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.088407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 111/213] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:11:51.093016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b17f1-c64e-4bc7-a54f-6ca51af99c9e None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.093303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b17f1-c64e-4bc7-a54f-6ca51af99c9e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.093580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b17f1-c64e-4bc7-a54f-6ca51af99c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.108309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656e725-1ca2-4ccc-8e0e-af5aa21f6396 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.110191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e20b17f1-c64e-4bc7-a54f-6ca51af99c9e None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:51.111400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e20b17f1-c64e-4bc7-a54f-6ca51af99c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:51.142388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd2d46-cf97-49bc-a65d-60a02e62088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.143320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd2d46-cf97-49bc-a65d-60a02e62088a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.143599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd2d46-cf97-49bc-a65d-60a02e62088a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.143874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd2d46-cf97-49bc-a65d-60a02e62088a None admin] PATH_INFO: `/v3/users/82a6f1e59fb3452a923113775160336f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.145050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd2d46-cf97-49bc-a65d-60a02e62088a None admin] RBAC: Authorizing `identity:get_user(user_id=82a6f1e59fb3452a923113775160336f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:51.146533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd2d46-cf97-49bc-a65d-60a02e62088a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.148165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 103/214] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/users/82a6f1e59fb3452a923113775160336f => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:51.149483 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938dd7d-0ef8-49bb-85a2-a16b65abdf81 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.149771 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938dd7d-0ef8-49bb-85a2-a16b65abdf81 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.150049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938dd7d-0ef8-49bb-85a2-a16b65abdf81 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.162057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 104/215] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:51.162057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938dd7d-0ef8-49bb-85a2-a16b65abdf81 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.179384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 112/216] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:11:51.180606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edbb14-065e-4d15-8fc6-86446305bae6 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.180898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edbb14-065e-4d15-8fc6-86446305bae6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.181176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edbb14-065e-4d15-8fc6-86446305bae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.196883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a3edbb14-065e-4d15-8fc6-86446305bae6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:51.198056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a3edbb14-065e-4d15-8fc6-86446305bae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:51.256125 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938dd7d-0ef8-49bb-85a2-a16b65abdf81 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.263285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 113/217] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:51.263986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edbb14-065e-4d15-8fc6-86446305bae6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.298328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067bf50-2756-4884-8049-9a702fb97b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.299165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067bf50-2756-4884-8049-9a702fb97b23 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.299449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067bf50-2756-4884-8049-9a702fb97b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.299724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067bf50-2756-4884-8049-9a702fb97b23 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.300905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067bf50-2756-4884-8049-9a702fb97b23 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:51.302377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067bf50-2756-4884-8049-9a702fb97b23 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.304099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 105/218] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:51.304924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067bf50-2756-4884-8049-9a702fb97b23 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.362321 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edbb14-065e-4d15-8fc6-86446305bae6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.393911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069eeee-1fd2-4aaa-bb39-a8e3301031ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.394749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069eeee-1fd2-4aaa-bb39-a8e3301031ff None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.395034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069eeee-1fd2-4aaa-bb39-a8e3301031ff None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.395306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069eeee-1fd2-4aaa-bb39-a8e3301031ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.400773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067bf50-2756-4884-8049-9a702fb97b23 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.405453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069eeee-1fd2-4aaa-bb39-a8e3301031ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:51.412728 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-f069eeee-1fd2-4aaa-bb39-a8e3301031ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:11:51.413924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 114/219] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:51.415383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc87eb-6828-40ed-baa1-e3395d7d40ff None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.415671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc87eb-6828-40ed-baa1-e3395d7d40ff None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.415948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc87eb-6828-40ed-baa1-e3395d7d40ff None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.418287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 115/220] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:51.418287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc87eb-6828-40ed-baa1-e3395d7d40ff None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.432969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66a6aa-37db-43fd-8260-af9c19bb2d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.433759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66a6aa-37db-43fd-8260-af9c19bb2d40 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.434040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66a6aa-37db-43fd-8260-af9c19bb2d40 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.434340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66a6aa-37db-43fd-8260-af9c19bb2d40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.443841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66a6aa-37db-43fd-8260-af9c19bb2d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:51.450697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-4b66a6aa-37db-43fd-8260-af9c19bb2d40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:11:51.451866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 106/221] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:51.453613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66a6aa-37db-43fd-8260-af9c19bb2d40 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.515057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc87eb-6828-40ed-baa1-e3395d7d40ff None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.546754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdb2ed-72fa-4803-90d8-a0a7f22a1f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.547636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb2ed-72fa-4803-90d8-a0a7f22a1f9b None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.547921 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb2ed-72fa-4803-90d8-a0a7f22a1f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.548039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66a6aa-37db-43fd-8260-af9c19bb2d40 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.548199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb2ed-72fa-4803-90d8-a0a7f22a1f9b None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff/users/82a6f1e59fb3452a923113775160336f/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.550158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdb2ed-72fa-4803-90d8-a0a7f22a1f9b None admin] RBAC: Authorizing `identity:create_grant(project_id=82a354954d4f4effbdd82df1d17d6dff, user_id=82a6f1e59fb3452a923113775160336f, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:51.551616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdb2ed-72fa-4803-90d8-a0a7f22a1f9b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.564021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 116/222] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:11:51 2022] PUT /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff/users/82a6f1e59fb3452a923113775160336f/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:51.565377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0d1b0-0f3f-4f8c-be5d-79a4b84eab96 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.565659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0d1b0-0f3f-4f8c-be5d-79a4b84eab96 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.565930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0d1b0-0f3f-4f8c-be5d-79a4b84eab96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.582745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e36c5-6b8f-4edb-9f28-19e4471aeec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.583442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e36c5-6b8f-4edb-9f28-19e4471aeec3 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.583730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e36c5-6b8f-4edb-9f28-19e4471aeec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.584009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e36c5-6b8f-4edb-9f28-19e4471aeec3 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.584584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-40a0d1b0-0f3f-4f8c-be5d-79a4b84eab96 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:51.584967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e36c5-6b8f-4edb-9f28-19e4471aeec3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:51.585149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e36c5-6b8f-4edb-9f28-19e4471aeec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:51.585805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-40a0d1b0-0f3f-4f8c-be5d-79a4b84eab96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:51.586537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e36c5-6b8f-4edb-9f28-19e4471aeec3 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.596319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 107/223] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:51.597526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e36c5-6b8f-4edb-9f28-19e4471aeec3 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.658970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 117/224] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:51.678397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0d1b0-0f3f-4f8c-be5d-79a4b84eab96 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.710164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e36c5-6b8f-4edb-9f28-19e4471aeec3 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.745189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3addf0-e71f-426c-9a42-349ab340c904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.746187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3addf0-e71f-426c-9a42-349ab340c904 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.746637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3addf0-e71f-426c-9a42-349ab340c904 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.747052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3addf0-e71f-426c-9a42-349ab340c904 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.747964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3addf0-e71f-426c-9a42-349ab340c904 None admin] RBAC: Adding query filter params (name=member) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:51.748405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3addf0-e71f-426c-9a42-349ab340c904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:51.749906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3addf0-e71f-426c-9a42-349ab340c904 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.758575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 108/225] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:51.759554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3addf0-e71f-426c-9a42-349ab340c904 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.779504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0d1b0-0f3f-4f8c-be5d-79a4b84eab96 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.813993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c6ce8-2edd-483f-95c4-318c63a4c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.814915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c6ce8-2edd-483f-95c4-318c63a4c1af None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.815197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c6ce8-2edd-483f-95c4-318c63a4c1af None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.815513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c6ce8-2edd-483f-95c4-318c63a4c1af None admin] PATH_INFO: `/v3/users/82a6f1e59fb3452a923113775160336f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.816662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c6ce8-2edd-483f-95c4-318c63a4c1af None admin] RBAC: Authorizing `identity:get_user(user_id=82a6f1e59fb3452a923113775160336f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:51.818107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c6ce8-2edd-483f-95c4-318c63a4c1af None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.822380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 118/226] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/users/82a6f1e59fb3452a923113775160336f => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:51.823402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c6ce8-2edd-483f-95c4-318c63a4c1af None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.859809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3addf0-e71f-426c-9a42-349ab340c904 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.892244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208e4db-a8bf-4d47-b548-fae7aaa81536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.893052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208e4db-a8bf-4d47-b548-fae7aaa81536 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.893342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208e4db-a8bf-4d47-b548-fae7aaa81536 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.893622 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208e4db-a8bf-4d47-b548-fae7aaa81536 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.895214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208e4db-a8bf-4d47-b548-fae7aaa81536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:51.896294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208e4db-a8bf-4d47-b548-fae7aaa81536 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.902428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 109/227] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:51.902428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208e4db-a8bf-4d47-b548-fae7aaa81536 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.919910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c6ce8-2edd-483f-95c4-318c63a4c1af None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.952427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491265a-eaae-4e8f-86b3-c54120125cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.953392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491265a-eaae-4e8f-86b3-c54120125cbe None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.953753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491265a-eaae-4e8f-86b3-c54120125cbe None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.954095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491265a-eaae-4e8f-86b3-c54120125cbe None admin] PATH_INFO: `/v3/users/58614f66c09347eaaa054fb354425bee` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.967137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491265a-eaae-4e8f-86b3-c54120125cbe None admin] RBAC: Authorizing `identity:get_user(user_id=58614f66c09347eaaa054fb354425bee)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:51.968585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491265a-eaae-4e8f-86b3-c54120125cbe None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.974632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 119/228] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/users/58614f66c09347eaaa054fb354425bee => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:51.974632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491265a-eaae-4e8f-86b3-c54120125cbe None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:51.995752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208e4db-a8bf-4d47-b548-fae7aaa81536 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:52.028432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edb08d-94ac-472e-b5a7-02e1e5c3c202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:52.029834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edb08d-94ac-472e-b5a7-02e1e5c3c202 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:52.030106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edb08d-94ac-472e-b5a7-02e1e5c3c202 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:52.030467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edb08d-94ac-472e-b5a7-02e1e5c3c202 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:52.031592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edb08d-94ac-472e-b5a7-02e1e5c3c202 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:52.033030 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edb08d-94ac-472e-b5a7-02e1e5c3c202 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:52.034782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 110/229] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:51 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:52.035545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edb08d-94ac-472e-b5a7-02e1e5c3c202 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:52.069633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491265a-eaae-4e8f-86b3-c54120125cbe None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:52.102222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d817bb-d5d8-4000-8f0d-5bfc693716e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:52.102908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d817bb-d5d8-4000-8f0d-5bfc693716e6 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:52.103191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d817bb-d5d8-4000-8f0d-5bfc693716e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:52.103465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d817bb-d5d8-4000-8f0d-5bfc693716e6 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:52.104272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d817bb-d5d8-4000-8f0d-5bfc693716e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:52.105718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d817bb-d5d8-4000-8f0d-5bfc693716e6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:52.125778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 120/230] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:11:51 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:52.134545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d817bb-d5d8-4000-8f0d-5bfc693716e6 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:52.137997 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edb08d-94ac-472e-b5a7-02e1e5c3c202 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:52.176400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e09b7a-1c5b-4a23-9c65-2ec5eb86e96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:52.176986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e09b7a-1c5b-4a23-9c65-2ec5eb86e96a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:52.177347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e09b7a-1c5b-4a23-9c65-2ec5eb86e96a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:52.177638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e09b7a-1c5b-4a23-9c65-2ec5eb86e96a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:52.245831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d817bb-d5d8-4000-8f0d-5bfc693716e6 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:52.253368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e09b7a-1c5b-4a23-9c65-2ec5eb86e96a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:52.254982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e09b7a-1c5b-4a23-9c65-2ec5eb86e96a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:52.281607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fc024-3d19-4d0a-95e2-94ee1b707ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:52.282546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fc024-3d19-4d0a-95e2-94ee1b707ad2 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:52.282834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fc024-3d19-4d0a-95e2-94ee1b707ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:52.283113 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fc024-3d19-4d0a-95e2-94ee1b707ad2 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff/users/82a6f1e59fb3452a923113775160336f/roles/3950e5fe56724635b0bd65e6d20fcd1d` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:52.285391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fc024-3d19-4d0a-95e2-94ee1b707ad2 None admin] RBAC: Authorizing `identity:create_grant(project_id=82a354954d4f4effbdd82df1d17d6dff, user_id=82a6f1e59fb3452a923113775160336f, role_id=3950e5fe56724635b0bd65e6d20fcd1d)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:52.286876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fc024-3d19-4d0a-95e2-94ee1b707ad2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:52.305532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 121/231] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:11:52 2022] PUT /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff/users/82a6f1e59fb3452a923113775160336f/roles/3950e5fe56724635b0bd65e6d20fcd1d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:52.383610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 111/232] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:52.389322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fc024-3d19-4d0a-95e2-94ee1b707ad2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:52.500500 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fc024-3d19-4d0a-95e2-94ee1b707ad2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:52.535291 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d54fc2-735a-4c6d-9853-94a51ef21302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:52.536156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d54fc2-735a-4c6d-9853-94a51ef21302 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:52.536435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d54fc2-735a-4c6d-9853-94a51ef21302 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:52.536705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d54fc2-735a-4c6d-9853-94a51ef21302 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:52.537878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d54fc2-735a-4c6d-9853-94a51ef21302 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:52.539344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d54fc2-735a-4c6d-9853-94a51ef21302 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:52.541285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 122/233] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:52 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:52.547698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e09b7a-1c5b-4a23-9c65-2ec5eb86e96a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:52.647058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e09b7a-1c5b-4a23-9c65-2ec5eb86e96a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:52.681730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164fb9f-4f64-415b-b5de-63e048f71887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:52.682427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164fb9f-4f64-415b-b5de-63e048f71887 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:52.682711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164fb9f-4f64-415b-b5de-63e048f71887 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:52.682984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164fb9f-4f64-415b-b5de-63e048f71887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:52.683811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164fb9f-4f64-415b-b5de-63e048f71887 None admin] RBAC: Adding query filter params (role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=82a354954d4f4effbdd82df1d17d6dff, user.id=58614f66c09347eaaa054fb354425bee) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:52.684116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164fb9f-4f64-415b-b5de-63e048f71887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:52.686116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164fb9f-4f64-415b-b5de-63e048f71887 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:52.691732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 112/234] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:52 2022] GET /identity/v3/role_assignments?user.id=58614f66c09347eaaa054fb354425bee&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:54.210088 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711587ce-f39e-48b2-927f-b81a70427843 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:54.210624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711587ce-f39e-48b2-927f-b81a70427843 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:54.210699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711587ce-f39e-48b2-927f-b81a70427843 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:54.212297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 123/235] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:54.217933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e632-4313-4d11-a44d-8f7ba8f0b82a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:54.218362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e632-4313-4d11-a44d-8f7ba8f0b82a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:54.218548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e632-4313-4d11-a44d-8f7ba8f0b82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:54.243230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6152e632-4313-4d11-a44d-8f7ba8f0b82a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:54.244434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6152e632-4313-4d11-a44d-8f7ba8f0b82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:54.340921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 113/236] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:11:54.366715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711587ce-f39e-48b2-927f-b81a70427843 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:54.487945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711587ce-f39e-48b2-927f-b81a70427843 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:54.530096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7dde3-5c0f-46c8-b205-926036928a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:54.530925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7dde3-5c0f-46c8-b205-926036928a93 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:54.531207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7dde3-5c0f-46c8-b205-926036928a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:54.531478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7dde3-5c0f-46c8-b205-926036928a93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:54.542015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff7dde3-5c0f-46c8-b205-926036928a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:54.553099 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-dff7dde3-5c0f-46c8-b205-926036928a93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:11:54.554349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 124/237] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:11:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:54.560814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e632-4313-4d11-a44d-8f7ba8f0b82a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:54.675788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e632-4313-4d11-a44d-8f7ba8f0b82a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:54.714055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c40c5-123f-40da-a474-718e07680476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:54.714787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c40c5-123f-40da-a474-718e07680476 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:54.715071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c40c5-123f-40da-a474-718e07680476 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:54.715351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c40c5-123f-40da-a474-718e07680476 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:54.716679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c40c5-123f-40da-a474-718e07680476 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:54.716989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c40c5-123f-40da-a474-718e07680476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:54.718461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c40c5-123f-40da-a474-718e07680476 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:54.728434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 114/238] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:54.735199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7dde3-5c0f-46c8-b205-926036928a93 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:54.879025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7dde3-5c0f-46c8-b205-926036928a93 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:54.930176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb7f0a-a2d1-4e18-a0ca-d8f37e8033f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:54.931086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb7f0a-a2d1-4e18-a0ca-d8f37e8033f4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:54.931372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb7f0a-a2d1-4e18-a0ca-d8f37e8033f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:54.931652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb7f0a-a2d1-4e18-a0ca-d8f37e8033f4 None admin] PATH_INFO: `/v3/users/82a6f1e59fb3452a923113775160336f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:54.932865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb7f0a-a2d1-4e18-a0ca-d8f37e8033f4 None admin] RBAC: Authorizing `identity:get_user(user_id=82a6f1e59fb3452a923113775160336f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:54.934328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb7f0a-a2d1-4e18-a0ca-d8f37e8033f4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:54.936294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 125/239] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:54 2022] GET /identity/v3/users/82a6f1e59fb3452a923113775160336f => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:54.941632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c40c5-123f-40da-a474-718e07680476 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:55.044919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c40c5-123f-40da-a474-718e07680476 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:55.089750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302e499-be34-4fb2-9be5-118a0e69f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:55.090437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302e499-be34-4fb2-9be5-118a0e69f438 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.090723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302e499-be34-4fb2-9be5-118a0e69f438 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.091055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302e499-be34-4fb2-9be5-118a0e69f438 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.166958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47104be-76af-4a0b-81cb-847abca27357 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.167575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47104be-76af-4a0b-81cb-847abca27357 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.167914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47104be-76af-4a0b-81cb-847abca27357 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.169783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 126/240] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:11:55.177157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302e499-be34-4fb2-9be5-118a0e69f438 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:55.178643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9fda-03f9-4bdd-81c0-2235cb4e67d8 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.178834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302e499-be34-4fb2-9be5-118a0e69f438 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:55.179392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9fda-03f9-4bdd-81c0-2235cb4e67d8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.179869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9fda-03f9-4bdd-81c0-2235cb4e67d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.219259 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e41e9fda-03f9-4bdd-81c0-2235cb4e67d8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:55.221218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e41e9fda-03f9-4bdd-81c0-2235cb4e67d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:55.277697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 115/241] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:55.284187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302e499-be34-4fb2-9be5-118a0e69f438 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:55.347640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 127/242] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:55.371418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351bbf1-822b-4f10-832d-eb0852eb3606 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.371958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351bbf1-822b-4f10-832d-eb0852eb3606 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.372485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351bbf1-822b-4f10-832d-eb0852eb3606 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.377458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 128/243] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:11:55.379284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28819-4b22-462d-bf1e-98a91c33da5e None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.379736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28819-4b22-462d-bf1e-98a91c33da5e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.380170 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a28819-4b22-462d-bf1e-98a91c33da5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.389766 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302e499-be34-4fb2-9be5-118a0e69f438 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:55.406966 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-30a28819-4b22-462d-bf1e-98a91c33da5e None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:55.408287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-30a28819-4b22-462d-bf1e-98a91c33da5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:55.424585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f13e09-26d9-497a-b142-032ba34a31fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:55.425429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f13e09-26d9-497a-b142-032ba34a31fa None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.425709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f13e09-26d9-497a-b142-032ba34a31fa None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.425985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f13e09-26d9-497a-b142-032ba34a31fa None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.427233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f13e09-26d9-497a-b142-032ba34a31fa None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:55.428665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f13e09-26d9-497a-b142-032ba34a31fa None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:55.430743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 116/244] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:55 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:55.431708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f13e09-26d9-497a-b142-032ba34a31fa None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:55.482505 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 129/245] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:55.483533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28819-4b22-462d-bf1e-98a91c33da5e None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:55.529786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f13e09-26d9-497a-b142-032ba34a31fa None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:55.560813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b19c-8bba-47d1-a8c2-3bd442b862e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:55.561610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b19c-8bba-47d1-a8c2-3bd442b862e6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.561887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b19c-8bba-47d1-a8c2-3bd442b862e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.562154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b19c-8bba-47d1-a8c2-3bd442b862e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.571671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535b19c-8bba-47d1-a8c2-3bd442b862e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:55.577117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a28819-4b22-462d-bf1e-98a91c33da5e None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:55.579392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-b535b19c-8bba-47d1-a8c2-3bd442b862e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:11:55.580573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 117/246] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:11:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:55.581719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e12d17-4d03-4dfe-b8c5-ac202fa4dbfc None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.582000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e12d17-4d03-4dfe-b8c5-ac202fa4dbfc None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.582286 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e12d17-4d03-4dfe-b8c5-ac202fa4dbfc None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.583722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 118/247] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:55.584626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69229383-e957-4d22-981e-3c1a96dc9a0e None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.585640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69229383-e957-4d22-981e-3c1a96dc9a0e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.585640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69229383-e957-4d22-981e-3c1a96dc9a0e None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.586442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 119/248] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:55.587000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69229383-e957-4d22-981e-3c1a96dc9a0e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:55.615762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26830860-192a-48f9-ba5a-c925ffb1577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:55.616423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26830860-192a-48f9-ba5a-c925ffb1577f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.616713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26830860-192a-48f9-ba5a-c925ffb1577f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.616987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26830860-192a-48f9-ba5a-c925ffb1577f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.617813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26830860-192a-48f9-ba5a-c925ffb1577f None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=82a354954d4f4effbdd82df1d17d6dff, user.id=82a6f1e59fb3452a923113775160336f) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:55.618124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26830860-192a-48f9-ba5a-c925ffb1577f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:55.619597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26830860-192a-48f9-ba5a-c925ffb1577f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:55.625384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 130/249] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:55 2022] GET /identity/v3/role_assignments?user.id=82a6f1e59fb3452a923113775160336f&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=f0208c43117c4b799194c83781a46e09 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:55.626002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26830860-192a-48f9-ba5a-c925ffb1577f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:55.690903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69229383-e957-4d22-981e-3c1a96dc9a0e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:55.728024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7141a4-43cd-4cf8-8cc0-d3760119ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:55.729685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7141a4-43cd-4cf8-8cc0-d3760119ca7b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.730185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7141a4-43cd-4cf8-8cc0-d3760119ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.731071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7141a4-43cd-4cf8-8cc0-d3760119ca7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.743029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7141a4-43cd-4cf8-8cc0-d3760119ca7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:55.750770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-8e7141a4-43cd-4cf8-8cc0-d3760119ca7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 00:11:55.752055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 120/250] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:55.753548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26830860-192a-48f9-ba5a-c925ffb1577f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:55.758289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a703c-b089-451a-a004-0bf0e7ff6ce2 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.758584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a703c-b089-451a-a004-0bf0e7ff6ce2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.758869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a703c-b089-451a-a004-0bf0e7ff6ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.778910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b51a703c-b089-451a-a004-0bf0e7ff6ce2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:55.780398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b51a703c-b089-451a-a004-0bf0e7ff6ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:55.791153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d57a57-0df5-42b8-9be2-f95dd4fce358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:55.791843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57a57-0df5-42b8-9be2-f95dd4fce358 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.792125 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57a57-0df5-42b8-9be2-f95dd4fce358 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.792397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d57a57-0df5-42b8-9be2-f95dd4fce358 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.793155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57a57-0df5-42b8-9be2-f95dd4fce358 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:55.793453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57a57-0df5-42b8-9be2-f95dd4fce358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:55.795473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d57a57-0df5-42b8-9be2-f95dd4fce358 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:55.803986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 131/251] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:11:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:55.805273 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f5e6-0b3a-488e-8b9e-1dff4b5852a6 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:55.805561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f5e6-0b3a-488e-8b9e-1dff4b5852a6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:55.805841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283f5e6-0b3a-488e-8b9e-1dff4b5852a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:55.826146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-8283f5e6-0b3a-488e-8b9e-1dff4b5852a6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:55.827675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8283f5e6-0b3a-488e-8b9e-1dff4b5852a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:55.868427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 121/252] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:55.869279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a703c-b089-451a-a004-0bf0e7ff6ce2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:55.903074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 132/253] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:55.909690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283f5e6-0b3a-488e-8b9e-1dff4b5852a6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:55.967489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a703c-b089-451a-a004-0bf0e7ff6ce2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:55.999117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167092b-ee67-4997-a425-5d508e0be7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:55.999789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167092b-ee67-4997-a425-5d508e0be7ea None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.000069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167092b-ee67-4997-a425-5d508e0be7ea None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.000351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167092b-ee67-4997-a425-5d508e0be7ea None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.001095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167092b-ee67-4997-a425-5d508e0be7ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:56.001399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167092b-ee67-4997-a425-5d508e0be7ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.001963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283f5e6-0b3a-488e-8b9e-1dff4b5852a6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.002805 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167092b-ee67-4997-a425-5d508e0be7ea None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.010479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 122/254] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:56.011564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167092b-ee67-4997-a425-5d508e0be7ea None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.033975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936dfd2-f1ad-4676-aaae-2664dc6f6868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.034892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936dfd2-f1ad-4676-aaae-2664dc6f6868 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.035168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936dfd2-f1ad-4676-aaae-2664dc6f6868 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.035445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936dfd2-f1ad-4676-aaae-2664dc6f6868 None admin] PATH_INFO: `/v3/users/82a6f1e59fb3452a923113775160336f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.036599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936dfd2-f1ad-4676-aaae-2664dc6f6868 None admin] RBAC: Authorizing `identity:get_user(user_id=82a6f1e59fb3452a923113775160336f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.038017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936dfd2-f1ad-4676-aaae-2664dc6f6868 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.039887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 133/255] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:55 2022] GET /identity/v3/users/82a6f1e59fb3452a923113775160336f => generated 283 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:56.040628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936dfd2-f1ad-4676-aaae-2664dc6f6868 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.104614 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167092b-ee67-4997-a425-5d508e0be7ea None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.130605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936dfd2-f1ad-4676-aaae-2664dc6f6868 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.135524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdfe14-d1c3-419d-9a7a-d7d3283684a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.136305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdfe14-d1c3-419d-9a7a-d7d3283684a2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.136585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdfe14-d1c3-419d-9a7a-d7d3283684a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.136856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdfe14-d1c3-419d-9a7a-d7d3283684a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.138553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdfe14-d1c3-419d-9a7a-d7d3283684a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.139992 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdfe14-d1c3-419d-9a7a-d7d3283684a2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.141578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 123/256] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:56.146058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdfe14-d1c3-419d-9a7a-d7d3283684a2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.163163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b21a19-7f10-476a-970c-1e51740c7efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.163946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21a19-7f10-476a-970c-1e51740c7efb None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.164223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21a19-7f10-476a-970c-1e51740c7efb None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.164497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b21a19-7f10-476a-970c-1e51740c7efb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.174721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b21a19-7f10-476a-970c-1e51740c7efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:56.181544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-a2b21a19-7f10-476a-970c-1e51740c7efb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:11:56.182736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 134/257] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:56.183486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b21a19-7f10-476a-970c-1e51740c7efb None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.235239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdfe14-d1c3-419d-9a7a-d7d3283684a2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.266467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02849a1-1a28-43e9-89e9-6d46eab75334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.267336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02849a1-1a28-43e9-89e9-6d46eab75334 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.267623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02849a1-1a28-43e9-89e9-6d46eab75334 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.267901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02849a1-1a28-43e9-89e9-6d46eab75334 None admin] PATH_INFO: `/v3/users/38086770ea374ec6ab532b3329992514` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.275662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b21a19-7f10-476a-970c-1e51740c7efb None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.281054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02849a1-1a28-43e9-89e9-6d46eab75334 None admin] RBAC: Authorizing `identity:get_user(user_id=38086770ea374ec6ab532b3329992514)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.282531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02849a1-1a28-43e9-89e9-6d46eab75334 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.284192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 124/258] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/users/38086770ea374ec6ab532b3329992514 => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:56.284937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02849a1-1a28-43e9-89e9-6d46eab75334 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.308326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f081a76-fbcd-46ce-b5a0-b712cfc5f9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.308974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081a76-fbcd-46ce-b5a0-b712cfc5f9d8 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.309257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081a76-fbcd-46ce-b5a0-b712cfc5f9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.309532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081a76-fbcd-46ce-b5a0-b712cfc5f9d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.372088 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f081a76-fbcd-46ce-b5a0-b712cfc5f9d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.373537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f081a76-fbcd-46ce-b5a0-b712cfc5f9d8 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.375648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02849a1-1a28-43e9-89e9-6d46eab75334 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.407196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71759788-d356-4e33-8a76-fa938d210c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.407849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71759788-d356-4e33-8a76-fa938d210c2d None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.408129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71759788-d356-4e33-8a76-fa938d210c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.408399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71759788-d356-4e33-8a76-fa938d210c2d None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.409095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71759788-d356-4e33-8a76-fa938d210c2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.410538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71759788-d356-4e33-8a76-fa938d210c2d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.435201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 125/259] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:11:56 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:56.435201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71759788-d356-4e33-8a76-fa938d210c2d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.472066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 135/260] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:56.473182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f081a76-fbcd-46ce-b5a0-b712cfc5f9d8 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.548703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71759788-d356-4e33-8a76-fa938d210c2d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.575126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f081a76-fbcd-46ce-b5a0-b712cfc5f9d8 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.583607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed377a-affa-4c4d-9f07-8601a7382021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.584287 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed377a-affa-4c4d-9f07-8601a7382021 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.584571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed377a-affa-4c4d-9f07-8601a7382021 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.584850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed377a-affa-4c4d-9f07-8601a7382021 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.585610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed377a-affa-4c4d-9f07-8601a7382021 None admin] RBAC: Adding query filter params (name=member) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:56.585923 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed377a-affa-4c4d-9f07-8601a7382021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.587377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed377a-affa-4c4d-9f07-8601a7382021 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.602629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 126/261] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:56.602629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed377a-affa-4c4d-9f07-8601a7382021 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.613550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef5181-195b-4ba4-9cdf-2daee85e9b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.614587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef5181-195b-4ba4-9cdf-2daee85e9b85 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.614587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef5181-195b-4ba4-9cdf-2daee85e9b85 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.614844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef5181-195b-4ba4-9cdf-2daee85e9b85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.684304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef5181-195b-4ba4-9cdf-2daee85e9b85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.685820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef5181-195b-4ba4-9cdf-2daee85e9b85 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.709654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed377a-affa-4c4d-9f07-8601a7382021 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.746711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae99f-2de2-4d7f-bb5b-5cc0e6ba7355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.747658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae99f-2de2-4d7f-bb5b-5cc0e6ba7355 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.747940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae99f-2de2-4d7f-bb5b-5cc0e6ba7355 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.748216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ae99f-2de2-4d7f-bb5b-5cc0e6ba7355 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.750073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae99f-2de2-4d7f-bb5b-5cc0e6ba7355 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.751566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ae99f-2de2-4d7f-bb5b-5cc0e6ba7355 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.753532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 127/262] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:56.754027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae99f-2de2-4d7f-bb5b-5cc0e6ba7355 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.794036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 136/263] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:11:56.795265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef5181-195b-4ba4-9cdf-2daee85e9b85 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.854300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ae99f-2de2-4d7f-bb5b-5cc0e6ba7355 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.889659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533d4a3-3347-420a-85a1-96dbc4e54ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.890635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533d4a3-3347-420a-85a1-96dbc4e54ace None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.890921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533d4a3-3347-420a-85a1-96dbc4e54ace None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.891195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533d4a3-3347-420a-85a1-96dbc4e54ace None admin] PATH_INFO: `/v3/users/58614f66c09347eaaa054fb354425bee` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.892460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533d4a3-3347-420a-85a1-96dbc4e54ace None admin] RBAC: Authorizing `identity:get_user(user_id=58614f66c09347eaaa054fb354425bee)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.894147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533d4a3-3347-420a-85a1-96dbc4e54ace None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.895721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 128/264] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/users/58614f66c09347eaaa054fb354425bee => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:56.896479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533d4a3-3347-420a-85a1-96dbc4e54ace None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.905582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef5181-195b-4ba4-9cdf-2daee85e9b85 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.939611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6762c-f7ac-4062-bbd8-bb628b268f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.940306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6762c-f7ac-4062-bbd8-bb628b268f58 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.940593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6762c-f7ac-4062-bbd8-bb628b268f58 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.940872 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6762c-f7ac-4062-bbd8-bb628b268f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.941710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6762c-f7ac-4062-bbd8-bb628b268f58 None admin] RBAC: Adding query filter params (role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=82a354954d4f4effbdd82df1d17d6dff, user.id=82a6f1e59fb3452a923113775160336f) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:56.942023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6762c-f7ac-4062-bbd8-bb628b268f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.943507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6762c-f7ac-4062-bbd8-bb628b268f58 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.949663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 137/265] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/role_assignments?user.id=82a6f1e59fb3452a923113775160336f&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:56.950916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6762c-f7ac-4062-bbd8-bb628b268f58 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.999659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533d4a3-3347-420a-85a1-96dbc4e54ace None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:57.051802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ddfcd-ae1f-4632-a2dc-dba3e96e9ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:57.052816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ddfcd-ae1f-4632-a2dc-dba3e96e9ea9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:57.053106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ddfcd-ae1f-4632-a2dc-dba3e96e9ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:57.053383 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ddfcd-ae1f-4632-a2dc-dba3e96e9ea9 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:57.057570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6762c-f7ac-4062-bbd8-bb628b268f58 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:57.059161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ddfcd-ae1f-4632-a2dc-dba3e96e9ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:57.060765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ddfcd-ae1f-4632-a2dc-dba3e96e9ea9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:57.062856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 129/266] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:57.069019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ddfcd-ae1f-4632-a2dc-dba3e96e9ea9 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:57.094378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46defd19-e56a-46fc-80ec-928140366e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:57.095268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46defd19-e56a-46fc-80ec-928140366e35 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:57.095553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46defd19-e56a-46fc-80ec-928140366e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:57.095835 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46defd19-e56a-46fc-80ec-928140366e35 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:57.097074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46defd19-e56a-46fc-80ec-928140366e35 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:57.098589 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46defd19-e56a-46fc-80ec-928140366e35 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:57.100712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 138/267] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:57.107266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46defd19-e56a-46fc-80ec-928140366e35 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:57.224301 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46defd19-e56a-46fc-80ec-928140366e35 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:57.238192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ddfcd-ae1f-4632-a2dc-dba3e96e9ea9 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:57.262177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010edf6-3cc5-453d-8024-564f818b07d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:57.263430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010edf6-3cc5-453d-8024-564f818b07d0 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:57.263995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010edf6-3cc5-453d-8024-564f818b07d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:57.264463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010edf6-3cc5-453d-8024-564f818b07d0 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff/users/58614f66c09347eaaa054fb354425bee/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:57.266697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010edf6-3cc5-453d-8024-564f818b07d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=82a354954d4f4effbdd82df1d17d6dff, user_id=58614f66c09347eaaa054fb354425bee, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:57.268438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010edf6-3cc5-453d-8024-564f818b07d0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:57.274565 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edc8e3-cba9-4e65-8ea0-188dbb504d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:57.275302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edc8e3-cba9-4e65-8ea0-188dbb504d67 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:57.275596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edc8e3-cba9-4e65-8ea0-188dbb504d67 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:57.275917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edc8e3-cba9-4e65-8ea0-188dbb504d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:57.276700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edc8e3-cba9-4e65-8ea0-188dbb504d67 None admin] RBAC: Adding query filter params (role.id=b7c28e17253a4f69a6341e791c4c75df, scope.project.id=82a354954d4f4effbdd82df1d17d6dff, user.id=38086770ea374ec6ab532b3329992514) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:57.277015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edc8e3-cba9-4e65-8ea0-188dbb504d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:57.279062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edc8e3-cba9-4e65-8ea0-188dbb504d67 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:57.284084 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 139/268] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:11:57 2022] PUT /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff/users/58614f66c09347eaaa054fb354425bee/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:57.290284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 130/269] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:11:57 2022] GET /identity/v3/role_assignments?user.id=38086770ea374ec6ab532b3329992514&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=b7c28e17253a4f69a6341e791c4c75df => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:59.000548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce85f60-816d-4a09-b20c-925974307645 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.001063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce85f60-816d-4a09-b20c-925974307645 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.001140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce85f60-816d-4a09-b20c-925974307645 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.002788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 140/270] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:59.008007 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452ac09-0786-4025-a1a3-b00167636985 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.008445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452ac09-0786-4025-a1a3-b00167636985 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.008625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452ac09-0786-4025-a1a3-b00167636985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.014453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1d479-5065-46d6-abe8-63db2a97fecd None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.014742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1d479-5065-46d6-abe8-63db2a97fecd None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.015019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1d479-5065-46d6-abe8-63db2a97fecd None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.016600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 141/271] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:59.026316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b5b84-1d2e-43e7-9827-24bfe8fbb689 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.026693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b5b84-1d2e-43e7-9827-24bfe8fbb689 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.027076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b5b84-1d2e-43e7-9827-24bfe8fbb689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.027405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5452ac09-0786-4025-a1a3-b00167636985 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:59.029118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5452ac09-0786-4025-a1a3-b00167636985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:59.044961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5a1b5b84-1d2e-43e7-9827-24bfe8fbb689 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:59.046325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5a1b5b84-1d2e-43e7-9827-24bfe8fbb689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:59.096368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 131/272] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:59.115740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 142/273] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:11:59.123519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452ac09-0786-4025-a1a3-b00167636985 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:59.142066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b5b84-1d2e-43e7-9827-24bfe8fbb689 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:59.222802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452ac09-0786-4025-a1a3-b00167636985 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:59.259363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecee7b-235f-454f-9998-538b130a347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:59.260542 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecee7b-235f-454f-9998-538b130a347b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.261018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecee7b-235f-454f-9998-538b130a347b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.261493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecee7b-235f-454f-9998-538b130a347b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.262291 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b5b84-1d2e-43e7-9827-24bfe8fbb689 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:59.274954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecee7b-235f-454f-9998-538b130a347b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:11:59.282793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-12ecee7b-235f-454f-9998-538b130a347b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:11:59.284696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 132/274] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:11:59.291358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecee7b-235f-454f-9998-538b130a347b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:59.309181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1a99-b829-4516-b659-b1fb7b30769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:59.310782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1a99-b829-4516-b659-b1fb7b30769e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.311267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1a99-b829-4516-b659-b1fb7b30769e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.311861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1a99-b829-4516-b659-b1fb7b30769e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.313542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a1a99-b829-4516-b659-b1fb7b30769e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:59.315208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a1a99-b829-4516-b659-b1fb7b30769e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:59.318066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 143/275] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:11:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:59.323855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1a99-b829-4516-b659-b1fb7b30769e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:59.397962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecee7b-235f-454f-9998-538b130a347b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:59.434419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95338b73-14ce-4c9c-8117-a0f879ae36da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:59.435343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338b73-14ce-4c9c-8117-a0f879ae36da None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.435690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338b73-14ce-4c9c-8117-a0f879ae36da None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.436033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338b73-14ce-4c9c-8117-a0f879ae36da None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.436911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95338b73-14ce-4c9c-8117-a0f879ae36da None admin] RBAC: Adding query filter params (name=member) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:59.437281 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95338b73-14ce-4c9c-8117-a0f879ae36da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:59.438760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95338b73-14ce-4c9c-8117-a0f879ae36da None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:59.440891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1a99-b829-4516-b659-b1fb7b30769e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:59.447381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 133/276] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:11:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:59.453151 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95338b73-14ce-4c9c-8117-a0f879ae36da None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:59.476300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49f79e-32ed-4114-a9f9-2d4ce8ebb7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:59.477301 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49f79e-32ed-4114-a9f9-2d4ce8ebb7b3 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.477800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49f79e-32ed-4114-a9f9-2d4ce8ebb7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.478285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49f79e-32ed-4114-a9f9-2d4ce8ebb7b3 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.479177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49f79e-32ed-4114-a9f9-2d4ce8ebb7b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:59.480806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49f79e-32ed-4114-a9f9-2d4ce8ebb7b3 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:59.505059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 144/277] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:11:59 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:11:59.568878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95338b73-14ce-4c9c-8117-a0f879ae36da None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:59.606656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff803b-1ec1-4762-930c-4664e606e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:59.607933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff803b-1ec1-4762-930c-4664e606e029 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.608416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff803b-1ec1-4762-930c-4664e606e029 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.608888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff803b-1ec1-4762-930c-4664e606e029 None admin] PATH_INFO: `/v3/users/ea3ee4e00f4a45cebdeafd7bcd056b66` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.624918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff803b-1ec1-4762-930c-4664e606e029 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ee4e00f4a45cebdeafd7bcd056b66)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:59.626778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff803b-1ec1-4762-930c-4664e606e029 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:59.629067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 134/278] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:11:59 2022] GET /identity/v3/users/ea3ee4e00f4a45cebdeafd7bcd056b66 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:11:59.635582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49f79e-32ed-4114-a9f9-2d4ce8ebb7b3 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:59.654188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758be2de-978d-4f5c-b9e7-9a7d026e05c0 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.654560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758be2de-978d-4f5c-b9e7-9a7d026e05c0 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.657407 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758be2de-978d-4f5c-b9e7-9a7d026e05c0 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.657407 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 135/279] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:59.661213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a641c-16bd-4659-a309-192b43bd22b1 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.661548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a641c-16bd-4659-a309-192b43bd22b1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.661965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a641c-16bd-4659-a309-192b43bd22b1 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.663607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 136/280] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:11:59.665012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2a96-f0b7-457b-96ce-2f3cd7699663 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.665348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2a96-f0b7-457b-96ce-2f3cd7699663 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.665628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2a96-f0b7-457b-96ce-2f3cd7699663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.682763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-98ce2a96-f0b7-457b-96ce-2f3cd7699663 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:59.683966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-98ce2a96-f0b7-457b-96ce-2f3cd7699663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:59.755137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 137/281] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:59.756418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bc4d-941c-4478-a38a-36293ee9407b None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.756704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bc4d-941c-4478-a38a-36293ee9407b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.756979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bc4d-941c-4478-a38a-36293ee9407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.771808 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49f79e-32ed-4114-a9f9-2d4ce8ebb7b3 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:59.777429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5d13bc4d-941c-4478-a38a-36293ee9407b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:59.777573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5d13bc4d-941c-4478-a38a-36293ee9407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:59.815641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e3b1-1cf0-4400-aa8f-f5834d9d2c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:59.816305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e3b1-1cf0-4400-aa8f-f5834d9d2c88 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.816584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e3b1-1cf0-4400-aa8f-f5834d9d2c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.816854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952e3b1-1cf0-4400-aa8f-f5834d9d2c88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.818126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952e3b1-1cf0-4400-aa8f-f5834d9d2c88 None admin] RBAC: Adding query filter params (role.id=7277e8dc4e284e59a5f04f5183b5c341, user.id=ea3ee4e00f4a45cebdeafd7bcd056b66, scope.system=all) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:11:59.818126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952e3b1-1cf0-4400-aa8f-f5834d9d2c88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:59.819610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952e3b1-1cf0-4400-aa8f-f5834d9d2c88 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:59.824949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 145/282] 10.222.0.32 () {56 vars in 1308 bytes} [Tue Apr 12 00:11:59 2022] GET /identity/v3/role_assignments?user.id=ea3ee4e00f4a45cebdeafd7bcd056b66&scope.system=all&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:11:59.826204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e3b1-1cf0-4400-aa8f-f5834d9d2c88 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:59.862198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 138/283] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:11:59.885374 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bc4d-941c-4478-a38a-36293ee9407b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:59.944250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952e3b1-1cf0-4400-aa8f-f5834d9d2c88 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:59.983791 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d320a5a-9f98-46b9-9a77-d95dca1eaf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:59.984608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d320a5a-9f98-46b9-9a77-d95dca1eaf0d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:59.984887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d320a5a-9f98-46b9-9a77-d95dca1eaf0d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:59.985160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d320a5a-9f98-46b9-9a77-d95dca1eaf0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:59.997982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d320a5a-9f98-46b9-9a77-d95dca1eaf0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:00.006145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-0d320a5a-9f98-46b9-9a77-d95dca1eaf0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:12:00.007744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 146/284] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:00.013990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d320a5a-9f98-46b9-9a77-d95dca1eaf0d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:00.015817 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bc4d-941c-4478-a38a-36293ee9407b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:00.061527 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326e2ec-6ff1-4c0e-8f22-5f04d9a3e42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:00.062854 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326e2ec-6ff1-4c0e-8f22-5f04d9a3e42e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:00.063343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326e2ec-6ff1-4c0e-8f22-5f04d9a3e42e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:00.063820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326e2ec-6ff1-4c0e-8f22-5f04d9a3e42e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:00.074741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326e2ec-6ff1-4c0e-8f22-5f04d9a3e42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:00.083477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-1326e2ec-6ff1-4c0e-8f22-5f04d9a3e42e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 00:12:00.085236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 139/285] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:11:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:00.091168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326e2ec-6ff1-4c0e-8f22-5f04d9a3e42e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:00.137556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d320a5a-9f98-46b9-9a77-d95dca1eaf0d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:00.204157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6ebb6-d9b8-4ade-8c02-298cb1f69316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:00.205272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6ebb6-d9b8-4ade-8c02-298cb1f69316 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:00.205760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6ebb6-d9b8-4ade-8c02-298cb1f69316 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:00.206270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6ebb6-d9b8-4ade-8c02-298cb1f69316 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:00.208578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6ebb6-d9b8-4ade-8c02-298cb1f69316 None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:00.209120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6ebb6-d9b8-4ade-8c02-298cb1f69316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:00.211826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6ebb6-d9b8-4ade-8c02-298cb1f69316 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:00.232151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 147/286] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:00.237490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6ebb6-d9b8-4ade-8c02-298cb1f69316 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:00.273190 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326e2ec-6ff1-4c0e-8f22-5f04d9a3e42e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:00.333749 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac4d5-b277-44d3-8736-22c6441f72d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:00.334366 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac4d5-b277-44d3-8736-22c6441f72d6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:00.334650 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac4d5-b277-44d3-8736-22c6441f72d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:00.334994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac4d5-b277-44d3-8736-22c6441f72d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:00.335745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ac4d5-b277-44d3-8736-22c6441f72d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:00.336050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ac4d5-b277-44d3-8736-22c6441f72d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:00.338594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ac4d5-b277-44d3-8736-22c6441f72d6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:00.354422 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 140/287] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:00.361713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac4d5-b277-44d3-8736-22c6441f72d6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:00.396758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6ebb6-d9b8-4ade-8c02-298cb1f69316 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:00.453148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821f922-b215-4fac-b3db-0e37e32e9faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:00.454021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821f922-b215-4fac-b3db-0e37e32e9faf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:00.454319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821f922-b215-4fac-b3db-0e37e32e9faf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:00.454596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821f922-b215-4fac-b3db-0e37e32e9faf None admin] PATH_INFO: `/v3/users/58614f66c09347eaaa054fb354425bee` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:00.457869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821f922-b215-4fac-b3db-0e37e32e9faf None admin] RBAC: Authorizing `identity:get_user(user_id=58614f66c09347eaaa054fb354425bee)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:00.459350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821f922-b215-4fac-b3db-0e37e32e9faf None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:00.462164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 148/288] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:12:00 2022] GET /identity/v3/users/58614f66c09347eaaa054fb354425bee => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:00.466158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821f922-b215-4fac-b3db-0e37e32e9faf None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:00.640870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac4d5-b277-44d3-8736-22c6441f72d6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:00.694745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a3052-459d-48f7-803d-ee700df6871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:00.698297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a3052-459d-48f7-803d-ee700df6871c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:00.698297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a3052-459d-48f7-803d-ee700df6871c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:00.698297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a3052-459d-48f7-803d-ee700df6871c None admin] PATH_INFO: `/v3/users/38086770ea374ec6ab532b3329992514` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:00.698570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821f922-b215-4fac-b3db-0e37e32e9faf None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:00.698679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a3052-459d-48f7-803d-ee700df6871c None admin] RBAC: Authorizing `identity:get_user(user_id=38086770ea374ec6ab532b3329992514)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:00.699069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2a3052-459d-48f7-803d-ee700df6871c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:00.702398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 141/289] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:12:00 2022] GET /identity/v3/users/38086770ea374ec6ab532b3329992514 => generated 297 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:00.711215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a3052-459d-48f7-803d-ee700df6871c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:00.739780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c7241-669b-4e18-8373-0448ef3cb1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:00.740602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c7241-669b-4e18-8373-0448ef3cb1cf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:00.740959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c7241-669b-4e18-8373-0448ef3cb1cf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:00.741307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c7241-669b-4e18-8373-0448ef3cb1cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:00.815378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c7241-669b-4e18-8373-0448ef3cb1cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:00.816854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c7241-669b-4e18-8373-0448ef3cb1cf None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:00.917711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2a3052-459d-48f7-803d-ee700df6871c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:00.956921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b665c9-74cb-4242-883b-a1debe2ec71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:00.958582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b665c9-74cb-4242-883b-a1debe2ec71b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:00.958872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b665c9-74cb-4242-883b-a1debe2ec71b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:00.959153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b665c9-74cb-4242-883b-a1debe2ec71b None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:00.960353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b665c9-74cb-4242-883b-a1debe2ec71b None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:00.961795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b665c9-74cb-4242-883b-a1debe2ec71b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:00.969300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 142/290] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:00 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:00.970549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b665c9-74cb-4242-883b-a1debe2ec71b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:01.027484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 149/291] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:01.035247 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c7241-669b-4e18-8373-0448ef3cb1cf None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:01.075123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b665c9-74cb-4242-883b-a1debe2ec71b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:01.110672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3138b-16c7-41e0-ac89-32459468c12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:01.112815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3138b-16c7-41e0-ac89-32459468c12e None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:01.112815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3138b-16c7-41e0-ac89-32459468c12e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:01.112815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3138b-16c7-41e0-ac89-32459468c12e None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff/users/38086770ea374ec6ab532b3329992514/roles/b7c28e17253a4f69a6341e791c4c75df` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:01.114429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3138b-16c7-41e0-ac89-32459468c12e None admin] RBAC: Authorizing `identity:create_grant(project_id=82a354954d4f4effbdd82df1d17d6dff, user_id=38086770ea374ec6ab532b3329992514, role_id=b7c28e17253a4f69a6341e791c4c75df)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:01.115961 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3138b-16c7-41e0-ac89-32459468c12e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:01.138482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 143/292] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:12:00 2022] PUT /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff/users/38086770ea374ec6ab532b3329992514/roles/b7c28e17253a4f69a6341e791c4c75df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:01.224564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c7241-669b-4e18-8373-0448ef3cb1cf None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:01.279010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18ff25-8f08-44c5-a310-48beae5f2574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:01.280139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ff25-8f08-44c5-a310-48beae5f2574 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:01.280564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ff25-8f08-44c5-a310-48beae5f2574 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:01.281002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ff25-8f08-44c5-a310-48beae5f2574 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:01.282461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18ff25-8f08-44c5-a310-48beae5f2574 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:01.284056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18ff25-8f08-44c5-a310-48beae5f2574 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:01.285945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 150/293] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:01 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:01.292155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3138b-16c7-41e0-ac89-32459468c12e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:01.411551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3138b-16c7-41e0-ac89-32459468c12e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:01.448449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9064d-9f40-482d-a8d5-114937a1707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:01.449194 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9064d-9f40-482d-a8d5-114937a1707b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:01.449531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9064d-9f40-482d-a8d5-114937a1707b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:01.449811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9064d-9f40-482d-a8d5-114937a1707b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:01.451204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9064d-9f40-482d-a8d5-114937a1707b None admin] RBAC: Adding query filter params (role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=82a354954d4f4effbdd82df1d17d6dff, user.id=58614f66c09347eaaa054fb354425bee) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:01.451516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9064d-9f40-482d-a8d5-114937a1707b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:01.452955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9064d-9f40-482d-a8d5-114937a1707b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:01.459552 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 144/294] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:01 2022] GET /identity/v3/role_assignments?user.id=58614f66c09347eaaa054fb354425bee&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:02.230645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092d606-4119-443f-bcef-13afd1e26e5e None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.231198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092d606-4119-443f-bcef-13afd1e26e5e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.231198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092d606-4119-443f-bcef-13afd1e26e5e None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.233381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 151/295] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:02.238756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b73fe-e732-4306-9309-545f19ae4a13 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.239637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b73fe-e732-4306-9309-545f19ae4a13 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.240138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b73fe-e732-4306-9309-545f19ae4a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.258216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-114b73fe-e732-4306-9309-545f19ae4a13 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:02.259723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-114b73fe-e732-4306-9309-545f19ae4a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:02.334352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 145/296] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:02.353332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092d606-4119-443f-bcef-13afd1e26e5e None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:02.455801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092d606-4119-443f-bcef-13afd1e26e5e None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:02.472733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332f53-8be1-493e-8be3-4f9e3ffcdd3b None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.473350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332f53-8be1-493e-8be3-4f9e3ffcdd3b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.473845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68332f53-8be1-493e-8be3-4f9e3ffcdd3b None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.476025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 146/297] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:02.484742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6a19-21c7-4be1-932a-053d3d47f955 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.485407 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6a19-21c7-4be1-932a-053d3d47f955 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.486236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba6a19-21c7-4be1-932a-053d3d47f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.495761 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dd7fe-9fc9-4252-be54-d18a68ef41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:02.496556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dd7fe-9fc9-4252-be54-d18a68ef41d0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.496835 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dd7fe-9fc9-4252-be54-d18a68ef41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.497199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dd7fe-9fc9-4252-be54-d18a68ef41d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.507196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0dd7fe-9fc9-4252-be54-d18a68ef41d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:02.508135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-3aba6a19-21c7-4be1-932a-053d3d47f955 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:02.509543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3aba6a19-21c7-4be1-932a-053d3d47f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:02.514067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-fc0dd7fe-9fc9-4252-be54-d18a68ef41d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 00:12:02.515826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 152/298] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:02.517132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abe380-3863-46ea-a142-1e463baf66e9 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.517416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abe380-3863-46ea-a142-1e463baf66e9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.517689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abe380-3863-46ea-a142-1e463baf66e9 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.519220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 153/299] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:02.520938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abe380-3863-46ea-a142-1e463baf66e9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:02.584620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 147/300] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:02.591908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd8323-b706-4a34-9627-b64175eef1cf None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.592209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd8323-b706-4a34-9627-b64175eef1cf None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.592496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd8323-b706-4a34-9627-b64175eef1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.611962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-3fcd8323-b706-4a34-9627-b64175eef1cf None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:02.613152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3fcd8323-b706-4a34-9627-b64175eef1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:02.625008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abe380-3863-46ea-a142-1e463baf66e9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:02.657393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6922f0e-5f1d-499d-ae9d-c78e076b094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:02.658065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922f0e-5f1d-499d-ae9d-c78e076b094c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.658374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922f0e-5f1d-499d-ae9d-c78e076b094c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.658650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6922f0e-5f1d-499d-ae9d-c78e076b094c None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.659387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922f0e-5f1d-499d-ae9d-c78e076b094c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:02.659692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922f0e-5f1d-499d-ae9d-c78e076b094c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:02.661057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6922f0e-5f1d-499d-ae9d-c78e076b094c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:02.670154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 154/301] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:02.670792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6922f0e-5f1d-499d-ae9d-c78e076b094c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:02.694071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 148/302] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:02.695223 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd8323-b706-4a34-9627-b64175eef1cf None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:02.780416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6922f0e-5f1d-499d-ae9d-c78e076b094c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:02.791978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd8323-b706-4a34-9627-b64175eef1cf None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:02.812402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8edfc8-92e7-42da-bee8-24dc6efb44e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:02.813193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8edfc8-92e7-42da-bee8-24dc6efb44e8 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.813474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8edfc8-92e7-42da-bee8-24dc6efb44e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.813748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8edfc8-92e7-42da-bee8-24dc6efb44e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.823376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8edfc8-92e7-42da-bee8-24dc6efb44e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:02.824719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64002d77-a2ed-49cc-bf39-78e3e8394536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:02.826135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64002d77-a2ed-49cc-bf39-78e3e8394536 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.826448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64002d77-a2ed-49cc-bf39-78e3e8394536 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.826727 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64002d77-a2ed-49cc-bf39-78e3e8394536 None admin] PATH_INFO: `/v3/users/0abe247000854b938aba28ad078355ec` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.830803 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-ab8edfc8-92e7-42da-bee8-24dc6efb44e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:12:02.836869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 155/303] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:02.836869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8edfc8-92e7-42da-bee8-24dc6efb44e8 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:02.839576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64002d77-a2ed-49cc-bf39-78e3e8394536 None admin] RBAC: Authorizing `identity:get_user(user_id=0abe247000854b938aba28ad078355ec)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:02.841073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64002d77-a2ed-49cc-bf39-78e3e8394536 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:02.842801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 149/304] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:12:02 2022] GET /identity/v3/users/0abe247000854b938aba28ad078355ec => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:02.848171 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64002d77-a2ed-49cc-bf39-78e3e8394536 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:02.935692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8edfc8-92e7-42da-bee8-24dc6efb44e8 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:02.948611 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64002d77-a2ed-49cc-bf39-78e3e8394536 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:02.971856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83441d-b960-4a68-b7c5-3b6f3ad7c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:02.972906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83441d-b960-4a68-b7c5-3b6f3ad7c77e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.973351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83441d-b960-4a68-b7c5-3b6f3ad7c77e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.973785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83441d-b960-4a68-b7c5-3b6f3ad7c77e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.975120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83441d-b960-4a68-b7c5-3b6f3ad7c77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:02.976718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83441d-b960-4a68-b7c5-3b6f3ad7c77e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:02.982018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 156/305] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:02.982879 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83441d-b960-4a68-b7c5-3b6f3ad7c77e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:02.985829 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc5703-c815-4c66-889e-e57a129726b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:02.986618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc5703-c815-4c66-889e-e57a129726b1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:02.986967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc5703-c815-4c66-889e-e57a129726b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:02.987248 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc5703-c815-4c66-889e-e57a129726b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:02.987995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc5703-c815-4c66-889e-e57a129726b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:02.988296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc5703-c815-4c66-889e-e57a129726b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:02.989650 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc5703-c815-4c66-889e-e57a129726b1 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:02.998412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 150/306] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:03.001081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc5703-c815-4c66-889e-e57a129726b1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:03.091729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83441d-b960-4a68-b7c5-3b6f3ad7c77e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:03.101388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc5703-c815-4c66-889e-e57a129726b1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:03.122766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b0ccc-473e-4ad4-91ab-18adf71da0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:03.123420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b0ccc-473e-4ad4-91ab-18adf71da0b2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:03.123702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b0ccc-473e-4ad4-91ab-18adf71da0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:03.123980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b0ccc-473e-4ad4-91ab-18adf71da0b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:03.124795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b0ccc-473e-4ad4-91ab-18adf71da0b2 None admin] RBAC: Adding query filter params (role.id=b7c28e17253a4f69a6341e791c4c75df, user.id=0abe247000854b938aba28ad078355ec, scope.system=all) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:03.125218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b0ccc-473e-4ad4-91ab-18adf71da0b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:03.126658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b0ccc-473e-4ad4-91ab-18adf71da0b2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:03.131558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 157/307] 10.222.0.32 () {56 vars in 1308 bytes} [Tue Apr 12 00:12:02 2022] GET /identity/v3/role_assignments?user.id=0abe247000854b938aba28ad078355ec&scope.system=all&role.id=b7c28e17253a4f69a6341e791c4c75df => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:03.132118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b0ccc-473e-4ad4-91ab-18adf71da0b2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:03.145822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df429e5f-4393-4944-9b5c-1cf98a2fcd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:03.146829 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df429e5f-4393-4944-9b5c-1cf98a2fcd22 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:03.147280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df429e5f-4393-4944-9b5c-1cf98a2fcd22 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:03.147714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df429e5f-4393-4944-9b5c-1cf98a2fcd22 None admin] PATH_INFO: `/v3/groups` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:03.148790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df429e5f-4393-4944-9b5c-1cf98a2fcd22 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:03.150520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df429e5f-4393-4944-9b5c-1cf98a2fcd22 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:03.178902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 151/308] 10.222.0.32 () {60 vars in 1134 bytes} [Tue Apr 12 00:12:02 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:03.275471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b0ccc-473e-4ad4-91ab-18adf71da0b2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:03.317009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0979315-9c43-43cf-8a37-446e7b36be88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:03.317912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979315-9c43-43cf-8a37-446e7b36be88 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:03.318191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979315-9c43-43cf-8a37-446e7b36be88 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:03.318497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979315-9c43-43cf-8a37-446e7b36be88 None admin] PATH_INFO: `/v3/users/ea3ee4e00f4a45cebdeafd7bcd056b66` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:03.319785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0979315-9c43-43cf-8a37-446e7b36be88 None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ee4e00f4a45cebdeafd7bcd056b66)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:03.321309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0979315-9c43-43cf-8a37-446e7b36be88 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:03.323311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 158/309] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:12:03 2022] GET /identity/v3/users/ea3ee4e00f4a45cebdeafd7bcd056b66 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:03.329946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df429e5f-4393-4944-9b5c-1cf98a2fcd22 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:03.442694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df429e5f-4393-4944-9b5c-1cf98a2fcd22 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:03.476054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7ef33-4f70-4be2-bd70-3ddfbc31cf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:03.476931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7ef33-4f70-4be2-bd70-3ddfbc31cf6e None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:03.477219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7ef33-4f70-4be2-bd70-3ddfbc31cf6e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:03.477501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7ef33-4f70-4be2-bd70-3ddfbc31cf6e None admin] PATH_INFO: `/v3/system/users/ea3ee4e00f4a45cebdeafd7bcd056b66/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:03.479035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7ef33-4f70-4be2-bd70-3ddfbc31cf6e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea3ee4e00f4a45cebdeafd7bcd056b66, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:03.480423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7ef33-4f70-4be2-bd70-3ddfbc31cf6e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:03.491482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 152/310] 10.222.0.32 () {58 vars in 1334 bytes} [Tue Apr 12 00:12:03 2022] PUT /identity/v3/system/users/ea3ee4e00f4a45cebdeafd7bcd056b66/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:03.747661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa9b1c-e73c-4b3c-bb06-c2aa971440a7 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:03.747850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa9b1c-e73c-4b3c-bb06-c2aa971440a7 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:03.748128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa9b1c-e73c-4b3c-bb06-c2aa971440a7 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:03.749738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 159/311] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:03.754938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0922de6-7885-4378-9b83-b0e677c74794 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:03.755450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0922de6-7885-4378-9b83-b0e677c74794 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:03.755959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0922de6-7885-4378-9b83-b0e677c74794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:03.773198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d0922de6-7885-4378-9b83-b0e677c74794 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:03.774700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d0922de6-7885-4378-9b83-b0e677c74794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:03.845400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 153/312] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:03.869924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa9b1c-e73c-4b3c-bb06-c2aa971440a7 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:03.971499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa9b1c-e73c-4b3c-bb06-c2aa971440a7 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:04.005938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba694f-a1e9-41bc-a111-f2011ec58210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:04.007064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba694f-a1e9-41bc-a111-f2011ec58210 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:04.007550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba694f-a1e9-41bc-a111-f2011ec58210 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:04.008003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba694f-a1e9-41bc-a111-f2011ec58210 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:04.018633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba694f-a1e9-41bc-a111-f2011ec58210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:04.025817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-9eba694f-a1e9-41bc-a111-f2011ec58210 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 00:12:04.032458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 160/313] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:04.033999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0922de6-7885-4378-9b83-b0e677c74794 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:04.132559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0922de6-7885-4378-9b83-b0e677c74794 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:04.166585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eae89-1d56-48e3-b8fe-378826ac898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:04.167556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eae89-1d56-48e3-b8fe-378826ac898a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:04.168023 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eae89-1d56-48e3-b8fe-378826ac898a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:04.168481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46eae89-1d56-48e3-b8fe-378826ac898a None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:04.169477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46eae89-1d56-48e3-b8fe-378826ac898a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:04.169986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46eae89-1d56-48e3-b8fe-378826ac898a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:04.171575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46eae89-1d56-48e3-b8fe-378826ac898a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:04.185042 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 154/314] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:04.190636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba694f-a1e9-41bc-a111-f2011ec58210 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:04.294666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba694f-a1e9-41bc-a111-f2011ec58210 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:04.331047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6b704-ccee-4b03-8ac2-a032e1a5e6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:04.332276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6b704-ccee-4b03-8ac2-a032e1a5e6f2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:04.332763 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6b704-ccee-4b03-8ac2-a032e1a5e6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:04.333294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6b704-ccee-4b03-8ac2-a032e1a5e6f2 None admin] PATH_INFO: `/v3/users/38086770ea374ec6ab532b3329992514` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:04.334795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6b704-ccee-4b03-8ac2-a032e1a5e6f2 None admin] RBAC: Authorizing `identity:get_user(user_id=38086770ea374ec6ab532b3329992514)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:04.336494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6b704-ccee-4b03-8ac2-a032e1a5e6f2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:04.338371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 161/315] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:12:04 2022] GET /identity/v3/users/38086770ea374ec6ab532b3329992514 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:04.344762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eae89-1d56-48e3-b8fe-378826ac898a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:04.445546 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46eae89-1d56-48e3-b8fe-378826ac898a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:04.481979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f0ce8-2e4c-45e1-85f2-61e793ba2a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:04.483053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f0ce8-2e4c-45e1-85f2-61e793ba2a47 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:04.483543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f0ce8-2e4c-45e1-85f2-61e793ba2a47 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:04.484087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f0ce8-2e4c-45e1-85f2-61e793ba2a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:04.551817 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f0ce8-2e4c-45e1-85f2-61e793ba2a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:04.553597 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f0ce8-2e4c-45e1-85f2-61e793ba2a47 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:04.652781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 155/316] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:04.658605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6b704-ccee-4b03-8ac2-a032e1a5e6f2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:04.759388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6b704-ccee-4b03-8ac2-a032e1a5e6f2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:04.793311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f1c81-9fc1-4ed5-bed4-f00dadab75d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:04.795091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f1c81-9fc1-4ed5-bed4-f00dadab75d7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:04.795580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f1c81-9fc1-4ed5-bed4-f00dadab75d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:04.796072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f1c81-9fc1-4ed5-bed4-f00dadab75d7 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:04.797484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f1c81-9fc1-4ed5-bed4-f00dadab75d7 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:04.799142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f1c81-9fc1-4ed5-bed4-f00dadab75d7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:04.805914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 162/317] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:04 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:04.807513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f0ce8-2e4c-45e1-85f2-61e793ba2a47 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:04.906397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f0ce8-2e4c-45e1-85f2-61e793ba2a47 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:04.945437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e0b6-8335-4270-ac51-b89ad8384050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:04.946103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e0b6-8335-4270-ac51-b89ad8384050 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:04.946419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e0b6-8335-4270-ac51-b89ad8384050 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:04.946700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e0b6-8335-4270-ac51-b89ad8384050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:04.947537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e0b6-8335-4270-ac51-b89ad8384050 None admin] RBAC: Adding query filter params (role.id=b7c28e17253a4f69a6341e791c4c75df, scope.project.id=82a354954d4f4effbdd82df1d17d6dff, user.id=38086770ea374ec6ab532b3329992514) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:04.947849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e0b6-8335-4270-ac51-b89ad8384050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:04.949290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e0b6-8335-4270-ac51-b89ad8384050 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:04.955531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 156/318] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:04 2022] GET /identity/v3/role_assignments?user.id=38086770ea374ec6ab532b3329992514&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=b7c28e17253a4f69a6341e791c4c75df => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:05.498142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9168-a780-45e7-97c4-43ff7bd3f0d1 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.498693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9168-a780-45e7-97c4-43ff7bd3f0d1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.498693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf9168-a780-45e7-97c4-43ff7bd3f0d1 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.500217 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 163/319] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:05.505264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a133-12c4-4671-a018-7b830162aba5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.505668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a133-12c4-4671-a018-7b830162aba5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.505846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a133-12c4-4671-a018-7b830162aba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.522088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c287a133-12c4-4671-a018-7b830162aba5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:05.523275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c287a133-12c4-4671-a018-7b830162aba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:05.586227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 157/320] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:05.608263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf9168-a780-45e7-97c4-43ff7bd3f0d1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:05.681882 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87e93-1d62-49b4-977d-c407c3b61b50 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.682180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87e93-1d62-49b4-977d-c407c3b61b50 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.682519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff87e93-1d62-49b4-977d-c407c3b61b50 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.683889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 158/321] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:12:05.689452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de9ce4-b97b-44eb-a8d7-d042a74f01cc None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.689880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de9ce4-b97b-44eb-a8d7-d042a74f01cc None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.690049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de9ce4-b97b-44eb-a8d7-d042a74f01cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.708298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a0de9ce4-b97b-44eb-a8d7-d042a74f01cc None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:05.709214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf9168-a780-45e7-97c4-43ff7bd3f0d1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:05.709487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a0de9ce4-b97b-44eb-a8d7-d042a74f01cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:05.740635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59face6-14ab-4e88-b2ca-125ce4b2f6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:05.741428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59face6-14ab-4e88-b2ca-125ce4b2f6b2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.741708 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59face6-14ab-4e88-b2ca-125ce4b2f6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.741982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59face6-14ab-4e88-b2ca-125ce4b2f6b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.752318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59face6-14ab-4e88-b2ca-125ce4b2f6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:05.759145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-b59face6-14ab-4e88-b2ca-125ce4b2f6b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 00:12:05.760492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 164/322] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:05.766533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59face6-14ab-4e88-b2ca-125ce4b2f6b2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:05.775067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 159/323] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:12:05.798181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de9ce4-b97b-44eb-a8d7-d042a74f01cc None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:05.865849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59face6-14ab-4e88-b2ca-125ce4b2f6b2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:05.889489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de9ce4-b97b-44eb-a8d7-d042a74f01cc None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:05.896742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa7751-6a00-4d1c-8400-03a3a4034147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:05.897400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7751-6a00-4d1c-8400-03a3a4034147 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.897681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7751-6a00-4d1c-8400-03a3a4034147 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.897955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7751-6a00-4d1c-8400-03a3a4034147 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.898747 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa7751-6a00-4d1c-8400-03a3a4034147 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:05.899033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa7751-6a00-4d1c-8400-03a3a4034147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:05.900382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa7751-6a00-4d1c-8400-03a3a4034147 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:05.908230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 165/324] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:05.909408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03245a65-681d-419e-8300-6ab079d0d0b6 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.909694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03245a65-681d-419e-8300-6ab079d0d0b6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.909968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03245a65-681d-419e-8300-6ab079d0d0b6 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.911358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 166/325] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:05.915396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03245a65-681d-419e-8300-6ab079d0d0b6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:05.922763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b2b99-3306-4a27-bb3c-cffe158f724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:05.923566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b2b99-3306-4a27-bb3c-cffe158f724a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.923849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b2b99-3306-4a27-bb3c-cffe158f724a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.924123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b2b99-3306-4a27-bb3c-cffe158f724a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.925296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b2b99-3306-4a27-bb3c-cffe158f724a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:05.926779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b2b99-3306-4a27-bb3c-cffe158f724a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:05.928372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 160/326] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:05.929493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329ec22-c6c4-49ce-b6ca-5b471db5d0a7 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.929776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329ec22-c6c4-49ce-b6ca-5b471db5d0a7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.930049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329ec22-c6c4-49ce-b6ca-5b471db5d0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.946225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d329ec22-c6c4-49ce-b6ca-5b471db5d0a7 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:05.947430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d329ec22-c6c4-49ce-b6ca-5b471db5d0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:06.008405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 161/327] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:06.009122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329ec22-c6c4-49ce-b6ca-5b471db5d0a7 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:06.010434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03245a65-681d-419e-8300-6ab079d0d0b6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:06.043048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef9426-6e2c-4f7a-8123-0a65838ed10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:06.043979 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef9426-6e2c-4f7a-8123-0a65838ed10a None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:06.044263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef9426-6e2c-4f7a-8123-0a65838ed10a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:06.044538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef9426-6e2c-4f7a-8123-0a65838ed10a None admin] PATH_INFO: `/v3/users/0abe247000854b938aba28ad078355ec` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:06.045701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef9426-6e2c-4f7a-8123-0a65838ed10a None admin] RBAC: Authorizing `identity:get_user(user_id=0abe247000854b938aba28ad078355ec)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:06.047205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef9426-6e2c-4f7a-8123-0a65838ed10a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:06.048830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 167/328] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:12:05 2022] GET /identity/v3/users/0abe247000854b938aba28ad078355ec => generated 293 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:06.049573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef9426-6e2c-4f7a-8123-0a65838ed10a None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:06.101272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d329ec22-c6c4-49ce-b6ca-5b471db5d0a7 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:06.131767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cd51a-f9c5-4782-951a-b1813bef4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:06.132416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cd51a-f9c5-4782-951a-b1813bef4c4e None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:06.132703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cd51a-f9c5-4782-951a-b1813bef4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:06.132974 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cd51a-f9c5-4782-951a-b1813bef4c4e None admin] PATH_INFO: `/v3/groups` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:06.133645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cd51a-f9c5-4782-951a-b1813bef4c4e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:06.135080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cd51a-f9c5-4782-951a-b1813bef4c4e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:06.145788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef9426-6e2c-4f7a-8123-0a65838ed10a None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:06.148625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 162/329] 10.222.0.32 () {60 vars in 1134 bytes} [Tue Apr 12 00:12:06 2022] POST /identity/v3/groups => generated 226 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:06.149431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cd51a-f9c5-4782-951a-b1813bef4c4e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:06.181049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac30e-06d6-4233-97e6-311496e73182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:06.181870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac30e-06d6-4233-97e6-311496e73182 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:06.182150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac30e-06d6-4233-97e6-311496e73182 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:06.182457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac30e-06d6-4233-97e6-311496e73182 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:06.194650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aac30e-06d6-4233-97e6-311496e73182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:06.201692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-18aac30e-06d6-4233-97e6-311496e73182 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:12:06.203178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 168/330] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:06.208906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac30e-06d6-4233-97e6-311496e73182 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:06.254958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cd51a-f9c5-4782-951a-b1813bef4c4e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:06.292491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cea65-2d54-4ddd-ab12-b0ad931ec3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:06.293285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cea65-2d54-4ddd-ab12-b0ad931ec3fa None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:06.293574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cea65-2d54-4ddd-ab12-b0ad931ec3fa None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:06.293934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758cea65-2d54-4ddd-ab12-b0ad931ec3fa None admin] PATH_INFO: `/v3/system/users/0abe247000854b938aba28ad078355ec/roles/b7c28e17253a4f69a6341e791c4c75df` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:06.295536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cea65-2d54-4ddd-ab12-b0ad931ec3fa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0abe247000854b938aba28ad078355ec, role_id=b7c28e17253a4f69a6341e791c4c75df)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:06.296933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758cea65-2d54-4ddd-ab12-b0ad931ec3fa None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:06.304514 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 163/331] 10.222.0.32 () {58 vars in 1334 bytes} [Tue Apr 12 00:12:06 2022] PUT /identity/v3/system/users/0abe247000854b938aba28ad078355ec/roles/b7c28e17253a4f69a6341e791c4c75df => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:06.315308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac30e-06d6-4233-97e6-311496e73182 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:06.353272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2896f4-ebb5-43f3-925f-34affbc66d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:06.353963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2896f4-ebb5-43f3-925f-34affbc66d59 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:06.354289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2896f4-ebb5-43f3-925f-34affbc66d59 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:06.354581 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2896f4-ebb5-43f3-925f-34affbc66d59 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:06.355334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2896f4-ebb5-43f3-925f-34affbc66d59 None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:06.355641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2896f4-ebb5-43f3-925f-34affbc66d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:06.357132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2896f4-ebb5-43f3-925f-34affbc66d59 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:06.366818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 169/332] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:06.373033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cea65-2d54-4ddd-ab12-b0ad931ec3fa None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:06.482881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758cea65-2d54-4ddd-ab12-b0ad931ec3fa None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:06.517953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f93e9d-2db7-41c6-8df9-a6d739b1711d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:06.518866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93e9d-2db7-41c6-8df9-a6d739b1711d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:06.519151 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93e9d-2db7-41c6-8df9-a6d739b1711d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:06.519425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f93e9d-2db7-41c6-8df9-a6d739b1711d None admin] PATH_INFO: `/v3/users/ea3ee4e00f4a45cebdeafd7bcd056b66` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:06.520621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f93e9d-2db7-41c6-8df9-a6d739b1711d None admin] RBAC: Authorizing `identity:get_user(user_id=ea3ee4e00f4a45cebdeafd7bcd056b66)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:06.522060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f93e9d-2db7-41c6-8df9-a6d739b1711d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:06.523927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 164/333] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:12:06 2022] GET /identity/v3/users/ea3ee4e00f4a45cebdeafd7bcd056b66 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:06.529462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2896f4-ebb5-43f3-925f-34affbc66d59 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:06.631228 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2896f4-ebb5-43f3-925f-34affbc66d59 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:06.665433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a155ba-9875-4681-b0d5-b7bf64fb0052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:06.666103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a155ba-9875-4681-b0d5-b7bf64fb0052 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:06.666417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a155ba-9875-4681-b0d5-b7bf64fb0052 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:06.666697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a155ba-9875-4681-b0d5-b7bf64fb0052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:06.667666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a155ba-9875-4681-b0d5-b7bf64fb0052 None admin] RBAC: Adding query filter params (role.id=7277e8dc4e284e59a5f04f5183b5c341, user.id=ea3ee4e00f4a45cebdeafd7bcd056b66, scope.system=all) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:06.667897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a155ba-9875-4681-b0d5-b7bf64fb0052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:06.669925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a155ba-9875-4681-b0d5-b7bf64fb0052 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:06.682676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 170/334] 10.222.0.32 () {56 vars in 1308 bytes} [Tue Apr 12 00:12:06 2022] GET /identity/v3/role_assignments?user.id=ea3ee4e00f4a45cebdeafd7bcd056b66&scope.system=all&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 510 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:08.790916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ffac-dd99-48f1-a249-82925eb1d2c4 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:08.791918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ffac-dd99-48f1-a249-82925eb1d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:08.792444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ffac-dd99-48f1-a249-82925eb1d2c4 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:08.794641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 165/335] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:08.800349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfc469-81e6-4a08-ac47-2489c514bf99 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:08.801177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfc469-81e6-4a08-ac47-2489c514bf99 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:08.801677 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfc469-81e6-4a08-ac47-2489c514bf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:08.820640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b7cfc469-81e6-4a08-ac47-2489c514bf99 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:08.822186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b7cfc469-81e6-4a08-ac47-2489c514bf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:08.908138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 171/336] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:08.952266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2ffac-dd99-48f1-a249-82925eb1d2c4 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:08.998121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b967-c39e-4be5-96fd-354de742f304 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:08.998796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b967-c39e-4be5-96fd-354de742f304 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:08.999289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b967-c39e-4be5-96fd-354de742f304 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.001150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 172/337] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:09.006014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201178b1-174e-431b-b96d-ee59ef09f2b5 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.006605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201178b1-174e-431b-b96d-ee59ef09f2b5 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.007081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201178b1-174e-431b-b96d-ee59ef09f2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.036366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-201178b1-174e-431b-b96d-ee59ef09f2b5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:09.037879 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-201178b1-174e-431b-b96d-ee59ef09f2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:09.088721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2ffac-dd99-48f1-a249-82925eb1d2c4 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:09.156824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 173/338] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:09.164305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dfbf8-0b7f-4114-ae52-90f44fcc6900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:09.165631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dfbf8-0b7f-4114-ae52-90f44fcc6900 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.166129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dfbf8-0b7f-4114-ae52-90f44fcc6900 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.166620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7dfbf8-0b7f-4114-ae52-90f44fcc6900 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.184438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7dfbf8-0b7f-4114-ae52-90f44fcc6900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:09.193034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201178b1-174e-431b-b96d-ee59ef09f2b5 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:09.204397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-8d7dfbf8-0b7f-4114-ae52-90f44fcc6900 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 12 00:12:09.207952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 166/339] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:09.211784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dfbf8-0b7f-4114-ae52-90f44fcc6900 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:09.337502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201178b1-174e-431b-b96d-ee59ef09f2b5 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:09.359755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7dfbf8-0b7f-4114-ae52-90f44fcc6900 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:09.374830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae6cc3-76d0-4183-beff-af38f4b30b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:09.376006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae6cc3-76d0-4183-beff-af38f4b30b3c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.376488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae6cc3-76d0-4183-beff-af38f4b30b3c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.376964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae6cc3-76d0-4183-beff-af38f4b30b3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.388683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae6cc3-76d0-4183-beff-af38f4b30b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:09.396025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-9cae6cc3-76d0-4183-beff-af38f4b30b3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:12:09.397856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 174/340] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:09.399734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ea78a-e605-4ab2-81a3-711090b77653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:09.400641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ea78a-e605-4ab2-81a3-711090b77653 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.400926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ea78a-e605-4ab2-81a3-711090b77653 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.401197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ea78a-e605-4ab2-81a3-711090b77653 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.401947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ea78a-e605-4ab2-81a3-711090b77653 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:09.402246 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ea78a-e605-4ab2-81a3-711090b77653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:09.404732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ea78a-e605-4ab2-81a3-711090b77653 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:09.409885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae6cc3-76d0-4183-beff-af38f4b30b3c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:09.413931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 167/341] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:09.419422 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ea78a-e605-4ab2-81a3-711090b77653 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:09.515484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae6cc3-76d0-4183-beff-af38f4b30b3c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:09.529709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ea78a-e605-4ab2-81a3-711090b77653 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:09.550652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b2de0-84d4-4dff-950d-7687f3e1cbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:09.551705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b2de0-84d4-4dff-950d-7687f3e1cbb7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.552195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b2de0-84d4-4dff-950d-7687f3e1cbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.552671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b2de0-84d4-4dff-950d-7687f3e1cbb7 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.553615 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b2de0-84d4-4dff-950d-7687f3e1cbb7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:09.554134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b2de0-84d4-4dff-950d-7687f3e1cbb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:09.555709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b2de0-84d4-4dff-950d-7687f3e1cbb7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:09.565740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 175/342] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:09.572400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af852049-f5dd-45d5-b95d-b97d06eabae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:09.573310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af852049-f5dd-45d5-b95d-b97d06eabae5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.573591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af852049-f5dd-45d5-b95d-b97d06eabae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.573862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af852049-f5dd-45d5-b95d-b97d06eabae5 None admin] PATH_INFO: `/v3/users/0abe247000854b938aba28ad078355ec` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.576568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af852049-f5dd-45d5-b95d-b97d06eabae5 None admin] RBAC: Authorizing `identity:get_user(user_id=0abe247000854b938aba28ad078355ec)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:09.577213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b2de0-84d4-4dff-950d-7687f3e1cbb7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:09.578427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af852049-f5dd-45d5-b95d-b97d06eabae5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:09.580373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 168/343] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:12:09 2022] GET /identity/v3/users/0abe247000854b938aba28ad078355ec => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:09.586119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af852049-f5dd-45d5-b95d-b97d06eabae5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:09.693003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b2de0-84d4-4dff-950d-7687f3e1cbb7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:09.716147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af852049-f5dd-45d5-b95d-b97d06eabae5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:09.728065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aabb92-6980-467c-aca0-fffb7380384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:09.729051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aabb92-6980-467c-aca0-fffb7380384c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.729534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aabb92-6980-467c-aca0-fffb7380384c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.730007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aabb92-6980-467c-aca0-fffb7380384c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.775046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd51d1d-c1b5-4a66-96b3-fb2c713b3506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:09.775641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd51d1d-c1b5-4a66-96b3-fb2c713b3506 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.775929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd51d1d-c1b5-4a66-96b3-fb2c713b3506 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.776205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd51d1d-c1b5-4a66-96b3-fb2c713b3506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.777062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd51d1d-c1b5-4a66-96b3-fb2c713b3506 None admin] RBAC: Adding query filter params (role.id=b7c28e17253a4f69a6341e791c4c75df, user.id=0abe247000854b938aba28ad078355ec, scope.system=all) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:09.777342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd51d1d-c1b5-4a66-96b3-fb2c713b3506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:09.779018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd51d1d-c1b5-4a66-96b3-fb2c713b3506 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:09.791604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 169/344] 10.222.0.32 () {56 vars in 1308 bytes} [Tue Apr 12 00:12:09 2022] GET /identity/v3/role_assignments?user.id=0abe247000854b938aba28ad078355ec&scope.system=all&role.id=b7c28e17253a4f69a6341e791c4c75df => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:09.801010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aabb92-6980-467c-aca0-fffb7380384c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:09.802860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aabb92-6980-467c-aca0-fffb7380384c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:09.879797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9cbd-04b9-421a-9180-046972460b5c None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.880439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9cbd-04b9-421a-9180-046972460b5c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.880916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9cbd-04b9-421a-9180-046972460b5c None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.886070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 170/345] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:09.891608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d8db-b70e-4c66-abb0-919c4375d50e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:09.892265 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d8db-b70e-4c66-abb0-919c4375d50e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:09.892743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473d8db-b70e-4c66-abb0-919c4375d50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:09.910020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 176/346] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:09.919608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aabb92-6980-467c-aca0-fffb7380384c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:09.922599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-3473d8db-b70e-4c66-abb0-919c4375d50e None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:09.924352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3473d8db-b70e-4c66-abb0-919c4375d50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:10.020734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 171/347] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:10.024608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aabb92-6980-467c-aca0-fffb7380384c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:10.060345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ae78e-d78f-460d-95ac-b80afff38d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:10.061149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ae78e-d78f-460d-95ac-b80afff38d66 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.061433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ae78e-d78f-460d-95ac-b80afff38d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.061707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ae78e-d78f-460d-95ac-b80afff38d66 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.065527 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473d8db-b70e-4c66-abb0-919c4375d50e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:10.067152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ae78e-d78f-460d-95ac-b80afff38d66 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:10.068641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ae78e-d78f-460d-95ac-b80afff38d66 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:10.070842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 177/348] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:09 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:10.081649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ae78e-d78f-460d-95ac-b80afff38d66 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:10.187701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ae78e-d78f-460d-95ac-b80afff38d66 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:10.221417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473d8db-b70e-4c66-abb0-919c4375d50e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:10.222771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bab53f-32c7-4bf6-b5a9-da574c8f017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:10.223841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bab53f-32c7-4bf6-b5a9-da574c8f017f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.224287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bab53f-32c7-4bf6-b5a9-da574c8f017f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.224792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bab53f-32c7-4bf6-b5a9-da574c8f017f None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.234694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bab53f-32c7-4bf6-b5a9-da574c8f017f None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:10.236480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bab53f-32c7-4bf6-b5a9-da574c8f017f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:10.238526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 178/349] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:10 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:10.240016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d085f-d012-4203-b156-af4d0b313d9f None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.240449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d085f-d012-4203-b156-af4d0b313d9f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.240881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d085f-d012-4203-b156-af4d0b313d9f None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.242298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 179/350] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:10.249076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7f982-050a-4270-874f-f5ba880246af None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.249908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7f982-050a-4270-874f-f5ba880246af None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.250376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7f982-050a-4270-874f-f5ba880246af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.267056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d331c34-e8fc-4094-a556-773a23757168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:10.268017 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d331c34-e8fc-4094-a556-773a23757168 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.268388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d331c34-e8fc-4094-a556-773a23757168 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.268750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d331c34-e8fc-4094-a556-773a23757168 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.272265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-30a7f982-050a-4270-874f-f5ba880246af None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:10.273965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-30a7f982-050a-4270-874f-f5ba880246af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:10.287540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d331c34-e8fc-4094-a556-773a23757168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:10.298191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-4d331c34-e8fc-4094-a556-773a23757168 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:12:10.299698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 172/351] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:12:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:10.301064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d331c34-e8fc-4094-a556-773a23757168 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:10.362805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 180/352] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:10.363960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7f982-050a-4270-874f-f5ba880246af None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:10.427239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d331c34-e8fc-4094-a556-773a23757168 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:10.468719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f079e-86d2-41cc-9d22-70d4baf0a11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:10.469893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f079e-86d2-41cc-9d22-70d4baf0a11e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.470416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f079e-86d2-41cc-9d22-70d4baf0a11e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.471214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f079e-86d2-41cc-9d22-70d4baf0a11e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.472497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f079e-86d2-41cc-9d22-70d4baf0a11e None admin] RBAC: Adding query filter params (group.id=8ae9e88883df49d6bb83b2f883cddddf, role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:10.473033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f079e-86d2-41cc-9d22-70d4baf0a11e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:10.475207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f079e-86d2-41cc-9d22-70d4baf0a11e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:10.477612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7f982-050a-4270-874f-f5ba880246af None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:10.482672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 173/353] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:10 2022] GET /identity/v3/role_assignments?group.id=8ae9e88883df49d6bb83b2f883cddddf&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:10.483712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f079e-86d2-41cc-9d22-70d4baf0a11e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:10.560698 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f5e2e-e553-44c9-b5d6-1f53250d6e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:10.562690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f5e2e-e553-44c9-b5d6-1f53250d6e62 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.565292 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f5e2e-e553-44c9-b5d6-1f53250d6e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.565929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f5e2e-e553-44c9-b5d6-1f53250d6e62 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.567263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f5e2e-e553-44c9-b5d6-1f53250d6e62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:10.569269 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f5e2e-e553-44c9-b5d6-1f53250d6e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:10.572786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f5e2e-e553-44c9-b5d6-1f53250d6e62 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:10.592355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 181/354] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:10.598400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f5e2e-e553-44c9-b5d6-1f53250d6e62 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:10.715570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f079e-86d2-41cc-9d22-70d4baf0a11e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:10.734225 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f5e2e-e553-44c9-b5d6-1f53250d6e62 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:10.761378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450be49-5994-4e92-98c4-11a5a5e4fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:10.762238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450be49-5994-4e92-98c4-11a5a5e4fb21 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.762528 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450be49-5994-4e92-98c4-11a5a5e4fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.762802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450be49-5994-4e92-98c4-11a5a5e4fb21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.780031 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9fc20-49a2-4831-aef8-b2ad0297ba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:10.780699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9fc20-49a2-4831-aef8-b2ad0297ba9d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.780978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9fc20-49a2-4831-aef8-b2ad0297ba9d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.781253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9fc20-49a2-4831-aef8-b2ad0297ba9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.782349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450be49-5994-4e92-98c4-11a5a5e4fb21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:10.789211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-2450be49-5994-4e92-98c4-11a5a5e4fb21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:12:10.790707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 174/355] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:10.796958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450be49-5994-4e92-98c4-11a5a5e4fb21 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:10.884893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9fc20-49a2-4831-aef8-b2ad0297ba9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:10.886375 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9fc20-49a2-4831-aef8-b2ad0297ba9d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:10.901454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450be49-5994-4e92-98c4-11a5a5e4fb21 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:10.939186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5af0d-9791-43cc-a3fc-cd39b12236ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:10.939865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5af0d-9791-43cc-a3fc-cd39b12236ef None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.940153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5af0d-9791-43cc-a3fc-cd39b12236ef None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.940436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5af0d-9791-43cc-a3fc-cd39b12236ef None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.941192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5af0d-9791-43cc-a3fc-cd39b12236ef None admin] RBAC: Adding query filter params (name=member) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:10.941500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5af0d-9791-43cc-a3fc-cd39b12236ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:10.942900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5af0d-9791-43cc-a3fc-cd39b12236ef None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:10.956934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 175/356] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:10.958568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5712f4e-61c4-4487-bd26-f8978b145b33 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:10.959011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5712f4e-61c4-4487-bd26-f8978b145b33 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:10.959442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5712f4e-61c4-4487-bd26-f8978b145b33 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:10.960853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 176/357] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:10.962120 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5712f4e-61c4-4487-bd26-f8978b145b33 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.002755 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 182/358] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:11.004431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f1277-192c-40ab-abc2-a96c2fa66097 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.009239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f1277-192c-40ab-abc2-a96c2fa66097 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.009688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f1277-192c-40ab-abc2-a96c2fa66097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.026075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4b7f1277-192c-40ab-abc2-a96c2fa66097 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:11.027482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4b7f1277-192c-40ab-abc2-a96c2fa66097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:11.077641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5712f4e-61c4-4487-bd26-f8978b145b33 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:11.095938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 183/359] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:11.096992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f1277-192c-40ab-abc2-a96c2fa66097 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.117749 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9070d6c-5fa4-4c7f-8cef-061f5eb97b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:11.118421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9070d6c-5fa4-4c7f-8cef-061f5eb97b2c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.118903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9070d6c-5fa4-4c7f-8cef-061f5eb97b2c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.119334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9070d6c-5fa4-4c7f-8cef-061f5eb97b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.194170 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f1277-192c-40ab-abc2-a96c2fa66097 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:11.198003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9070d6c-5fa4-4c7f-8cef-061f5eb97b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:11.199679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9070d6c-5fa4-4c7f-8cef-061f5eb97b2c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:11.228731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba51ba-77d9-40dc-ae7b-fb0df2601d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:11.229839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba51ba-77d9-40dc-ae7b-fb0df2601d3d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.230282 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba51ba-77d9-40dc-ae7b-fb0df2601d3d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.230697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba51ba-77d9-40dc-ae7b-fb0df2601d3d None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.232067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba51ba-77d9-40dc-ae7b-fb0df2601d3d None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:11.233619 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba51ba-77d9-40dc-ae7b-fb0df2601d3d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:11.235561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 184/360] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:11 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:11.236463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba51ba-77d9-40dc-ae7b-fb0df2601d3d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.312327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 177/361] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 00:12:11.313354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9070d6c-5fa4-4c7f-8cef-061f5eb97b2c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.340358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba51ba-77d9-40dc-ae7b-fb0df2601d3d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:11.374149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4d34c-8893-404a-8edc-388f2d2b8453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:11.375263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4d34c-8893-404a-8edc-388f2d2b8453 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.375678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4d34c-8893-404a-8edc-388f2d2b8453 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.376127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4d34c-8893-404a-8edc-388f2d2b8453 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.386608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4d34c-8893-404a-8edc-388f2d2b8453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:11.394610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-16f4d34c-8893-404a-8edc-388f2d2b8453 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:12:11.396009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 185/362] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:12:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:11.396900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4d34c-8893-404a-8edc-388f2d2b8453 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.419152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9070d6c-5fa4-4c7f-8cef-061f5eb97b2c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:11.456278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04e20f-f468-4e26-a95c-f2530b40c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:11.457437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e20f-f468-4e26-a95c-f2530b40c8fa None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.457898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e20f-f468-4e26-a95c-f2530b40c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.458348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04e20f-f468-4e26-a95c-f2530b40c8fa None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.459801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04e20f-f468-4e26-a95c-f2530b40c8fa None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:11.461459 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04e20f-f468-4e26-a95c-f2530b40c8fa None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:11.468243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 178/363] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:11 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:11.469871 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04e20f-f468-4e26-a95c-f2530b40c8fa None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.516191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4d34c-8893-404a-8edc-388f2d2b8453 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:11.556465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f6e6-c65e-4c1d-b9d4-1de22f225191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:11.557635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f6e6-c65e-4c1d-b9d4-1de22f225191 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.557917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f6e6-c65e-4c1d-b9d4-1de22f225191 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.558192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4433f6e6-c65e-4c1d-b9d4-1de22f225191 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.560212 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433f6e6-c65e-4c1d-b9d4-1de22f225191 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:11.561833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4433f6e6-c65e-4c1d-b9d4-1de22f225191 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:11.563802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 186/364] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:11 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:11.565648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f6e6-c65e-4c1d-b9d4-1de22f225191 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.587369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04e20f-f468-4e26-a95c-f2530b40c8fa None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:11.637325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf124ff-b131-4886-a82f-28fc1f869e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:11.638610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf124ff-b131-4886-a82f-28fc1f869e04 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.638907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf124ff-b131-4886-a82f-28fc1f869e04 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.639186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf124ff-b131-4886-a82f-28fc1f869e04 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.639940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf124ff-b131-4886-a82f-28fc1f869e04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:11.640459 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf124ff-b131-4886-a82f-28fc1f869e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:11.642028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf124ff-b131-4886-a82f-28fc1f869e04 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:11.651779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 179/365] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:11.653132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf124ff-b131-4886-a82f-28fc1f869e04 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.697192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4433f6e6-c65e-4c1d-b9d4-1de22f225191 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:11.742538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8889e2-93ce-45b2-ac9c-4aebf6843c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:11.743136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8889e2-93ce-45b2-ac9c-4aebf6843c97 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.743417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8889e2-93ce-45b2-ac9c-4aebf6843c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.743692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8889e2-93ce-45b2-ac9c-4aebf6843c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.744525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8889e2-93ce-45b2-ac9c-4aebf6843c97 None admin] RBAC: Adding query filter params (group.id=8ae9e88883df49d6bb83b2f883cddddf, role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:11.744832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8889e2-93ce-45b2-ac9c-4aebf6843c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:11.746264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8889e2-93ce-45b2-ac9c-4aebf6843c97 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:11.752423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 187/366] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:11 2022] GET /identity/v3/role_assignments?group.id=8ae9e88883df49d6bb83b2f883cddddf&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:11.753390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8889e2-93ce-45b2-ac9c-4aebf6843c97 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.785577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf124ff-b131-4886-a82f-28fc1f869e04 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:11.839553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2070fe-fab2-4b5d-b054-0aac8c6f455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:11.841166 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2070fe-fab2-4b5d-b054-0aac8c6f455f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.841594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2070fe-fab2-4b5d-b054-0aac8c6f455f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.842014 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2070fe-fab2-4b5d-b054-0aac8c6f455f None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.843501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2070fe-fab2-4b5d-b054-0aac8c6f455f None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:11.845209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2070fe-fab2-4b5d-b054-0aac8c6f455f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:11.847569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 180/367] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:11 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:11.849192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e1b20-94e0-445d-b997-ef703ad47352 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.849689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e1b20-94e0-445d-b997-ef703ad47352 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.850189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e1b20-94e0-445d-b997-ef703ad47352 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.856970 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 181/368] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:11.860352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e1b20-94e0-445d-b997-ef703ad47352 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:11.872307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8889e2-93ce-45b2-ac9c-4aebf6843c97 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:11.917076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee7b92-f80f-47cd-b568-a547c0f60262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:11.919134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee7b92-f80f-47cd-b568-a547c0f60262 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:11.919625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee7b92-f80f-47cd-b568-a547c0f60262 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:11.920466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee7b92-f80f-47cd-b568-a547c0f60262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:11.984799 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e1b20-94e0-445d-b997-ef703ad47352 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:12.002509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee7b92-f80f-47cd-b568-a547c0f60262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:12.004038 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee7b92-f80f-47cd-b568-a547c0f60262 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:12.033299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081c89-0a35-413c-a195-2abf30d29a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:12.034217 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081c89-0a35-413c-a195-2abf30d29a17 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:12.034537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081c89-0a35-413c-a195-2abf30d29a17 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:12.034967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081c89-0a35-413c-a195-2abf30d29a17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:12.036120 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081c89-0a35-413c-a195-2abf30d29a17 None admin] RBAC: Adding query filter params (group.id=8ae9e88883df49d6bb83b2f883cddddf, role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=82a354954d4f4effbdd82df1d17d6dff) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:12.036695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081c89-0a35-413c-a195-2abf30d29a17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:12.038619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081c89-0a35-413c-a195-2abf30d29a17 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:12.046608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 182/369] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:11 2022] GET /identity/v3/role_assignments?group.id=8ae9e88883df49d6bb83b2f883cddddf&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:12.048223 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7d408-a1b4-45f6-9cb2-25cb536b383c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:12.048736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7d408-a1b4-45f6-9cb2-25cb536b383c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:12.049212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7d408-a1b4-45f6-9cb2-25cb536b383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:12.069380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-bbd7d408-a1b4-45f6-9cb2-25cb536b383c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:12.071222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bbd7d408-a1b4-45f6-9cb2-25cb536b383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:12.166625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 188/370] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:12.167938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee7b92-f80f-47cd-b568-a547c0f60262 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:12.216251 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 183/371] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:12.255776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7d408-a1b4-45f6-9cb2-25cb536b383c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:12.281423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee7b92-f80f-47cd-b568-a547c0f60262 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:12.317192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c91c63-5fb7-4f96-87ef-b5996ce0b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:12.318063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c91c63-5fb7-4f96-87ef-b5996ce0b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:12.318376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c91c63-5fb7-4f96-87ef-b5996ce0b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:12.318654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c91c63-5fb7-4f96-87ef-b5996ce0b9f1 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:12.319863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c91c63-5fb7-4f96-87ef-b5996ce0b9f1 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:12.321298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c91c63-5fb7-4f96-87ef-b5996ce0b9f1 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:12.323387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 189/372] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:12 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:12.329472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c91c63-5fb7-4f96-87ef-b5996ce0b9f1 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:12.451315 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7d408-a1b4-45f6-9cb2-25cb536b383c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:12.492129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c91c63-5fb7-4f96-87ef-b5996ce0b9f1 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:12.512078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e8c8a-ddc1-48f9-b3f9-8477dfa496b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:12.513788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e8c8a-ddc1-48f9-b3f9-8477dfa496b7 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:12.514216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e8c8a-ddc1-48f9-b3f9-8477dfa496b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:12.514652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e8c8a-ddc1-48f9-b3f9-8477dfa496b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:12.528179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e8c8a-ddc1-48f9-b3f9-8477dfa496b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:12.535500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-8e4e8c8a-ddc1-48f9-b3f9-8477dfa496b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:12:12.537272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 184/373] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:12.551769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e8c8a-ddc1-48f9-b3f9-8477dfa496b7 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:12.563571 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47723e1-2259-41e6-9eb5-fcd3b75d3268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:12.564491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47723e1-2259-41e6-9eb5-fcd3b75d3268 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:12.564774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47723e1-2259-41e6-9eb5-fcd3b75d3268 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:12.565046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47723e1-2259-41e6-9eb5-fcd3b75d3268 None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:12.571593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47723e1-2259-41e6-9eb5-fcd3b75d3268 None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:12.573060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47723e1-2259-41e6-9eb5-fcd3b75d3268 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:12.574830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 190/374] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:12 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:12.583245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47723e1-2259-41e6-9eb5-fcd3b75d3268 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:12.760065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e8c8a-ddc1-48f9-b3f9-8477dfa496b7 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:12.839674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d16bd2-3b9f-4fe6-86b1-e4d702795fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:12.841224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16bd2-3b9f-4fe6-86b1-e4d702795fee None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:12.841718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16bd2-3b9f-4fe6-86b1-e4d702795fee None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:12.842204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d16bd2-3b9f-4fe6-86b1-e4d702795fee None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:12.843189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d16bd2-3b9f-4fe6-86b1-e4d702795fee None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:12.843735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d16bd2-3b9f-4fe6-86b1-e4d702795fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:12.845339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d16bd2-3b9f-4fe6-86b1-e4d702795fee None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:12.861596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 185/375] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:12.878123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d16bd2-3b9f-4fe6-86b1-e4d702795fee None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:12.907414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47723e1-2259-41e6-9eb5-fcd3b75d3268 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:12.945405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae0b0f-ff77-4e92-9e36-117bfde42fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:12.946914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae0b0f-ff77-4e92-9e36-117bfde42fdf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:12.949253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae0b0f-ff77-4e92-9e36-117bfde42fdf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:12.950301 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae0b0f-ff77-4e92-9e36-117bfde42fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:12.952012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae0b0f-ff77-4e92-9e36-117bfde42fdf None admin] RBAC: Adding query filter params (group.id=8ae9e88883df49d6bb83b2f883cddddf, role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=82a354954d4f4effbdd82df1d17d6dff) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:12.952477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae0b0f-ff77-4e92-9e36-117bfde42fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:12.958061 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae0b0f-ff77-4e92-9e36-117bfde42fdf None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:12.966325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 191/376] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:12 2022] GET /identity/v3/role_assignments?group.id=8ae9e88883df49d6bb83b2f883cddddf&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 260 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:13.039576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d16bd2-3b9f-4fe6-86b1-e4d702795fee None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:13.084757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5c47-f7e9-4c4e-8928-41f4dad621e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:13.085778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5c47-f7e9-4c4e-8928-41f4dad621e8 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:13.086204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5c47-f7e9-4c4e-8928-41f4dad621e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:13.086720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b5c47-f7e9-4c4e-8928-41f4dad621e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:13.169782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b5c47-f7e9-4c4e-8928-41f4dad621e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:13.171496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b5c47-f7e9-4c4e-8928-41f4dad621e8 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:13.260815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0651e2-d43c-4263-a600-3b3a10b39e0d None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:13.261144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0651e2-d43c-4263-a600-3b3a10b39e0d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:13.261381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0651e2-d43c-4263-a600-3b3a10b39e0d None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:13.263089 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 192/377] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:13.269327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c1b3f-01f4-4924-80b3-23f9cff70f96 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:13.269625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c1b3f-01f4-4924-80b3-23f9cff70f96 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:13.269906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c1b3f-01f4-4924-80b3-23f9cff70f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:13.299701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c81c1b3f-01f4-4924-80b3-23f9cff70f96 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:13.300889 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c81c1b3f-01f4-4924-80b3-23f9cff70f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:13.311216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 186/378] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 00:12:13.319293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5c47-f7e9-4c4e-8928-41f4dad621e8 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:13.412877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 193/379] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:13.437271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b5c47-f7e9-4c4e-8928-41f4dad621e8 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:13.451673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c1b3f-01f4-4924-80b3-23f9cff70f96 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:13.470977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ace78-b8c4-4af0-a224-ce64a355fe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:13.471838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ace78-b8c4-4af0-a224-ce64a355fe2f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:13.472119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ace78-b8c4-4af0-a224-ce64a355fe2f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:13.472390 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ace78-b8c4-4af0-a224-ce64a355fe2f None admin] PATH_INFO: `/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:13.473612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ace78-b8c4-4af0-a224-ce64a355fe2f None admin] RBAC: Authorizing `identity:get_project(project_id=fd9f2f2aa4034c3fa25d211a3bd7ce30)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:13.475103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ace78-b8c4-4af0-a224-ce64a355fe2f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:13.477061 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 187/380] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:13 2022] GET /identity/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:13.495648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ace78-b8c4-4af0-a224-ce64a355fe2f None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:13.566803 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c1b3f-01f4-4924-80b3-23f9cff70f96 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:13.603663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17ec72-ca53-402a-b3b7-65470f9459be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:13.604478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ec72-ca53-402a-b3b7-65470f9459be None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:13.604764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ec72-ca53-402a-b3b7-65470f9459be None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:13.605044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17ec72-ca53-402a-b3b7-65470f9459be None admin] PATH_INFO: `/v3/roles/member` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:13.615914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17ec72-ca53-402a-b3b7-65470f9459be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:13.619547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ace78-b8c4-4af0-a224-ce64a355fe2f None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:13.623117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2d17ec72-ca53-402a-b3b7-65470f9459be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:12:13.629134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 194/381] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:13.630370 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17ec72-ca53-402a-b3b7-65470f9459be None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:13.654670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa792e9-ace9-42ee-ab37-ed203c3441b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:13.655539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa792e9-ace9-42ee-ab37-ed203c3441b6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:13.655822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa792e9-ace9-42ee-ab37-ed203c3441b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:13.656099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa792e9-ace9-42ee-ab37-ed203c3441b6 None admin] PATH_INFO: `/v3/groups/9d304832a7ff4b209aaa204057255e4a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:13.662261 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa792e9-ace9-42ee-ab37-ed203c3441b6 None admin] RBAC: Authorizing `identity:get_group(group_id=9d304832a7ff4b209aaa204057255e4a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:13.663781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa792e9-ace9-42ee-ab37-ed203c3441b6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:13.666028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 188/382] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:13 2022] GET /identity/v3/groups/9d304832a7ff4b209aaa204057255e4a => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:13.671759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa792e9-ace9-42ee-ab37-ed203c3441b6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:13.804653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa792e9-ace9-42ee-ab37-ed203c3441b6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:13.845623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc1266-f1f9-4998-b177-53b06bf81039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:13.846409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc1266-f1f9-4998-b177-53b06bf81039 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:13.846623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc1266-f1f9-4998-b177-53b06bf81039 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:13.846936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc1266-f1f9-4998-b177-53b06bf81039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:13.847732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc1266-f1f9-4998-b177-53b06bf81039 None admin] RBAC: Adding query filter params (group.id=9d304832a7ff4b209aaa204057255e4a, role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=fd9f2f2aa4034c3fa25d211a3bd7ce30) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:13.848040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc1266-f1f9-4998-b177-53b06bf81039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:13.849476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc1266-f1f9-4998-b177-53b06bf81039 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:13.857104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 189/383] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:13 2022] GET /identity/v3/role_assignments?group.id=9d304832a7ff4b209aaa204057255e4a&scope.project.id=fd9f2f2aa4034c3fa25d211a3bd7ce30&role.id=f0208c43117c4b799194c83781a46e09 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:13.864363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17ec72-ca53-402a-b3b7-65470f9459be None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:13.940150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ec692-b11a-45e8-963b-e37f5794557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:13.940842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec692-b11a-45e8-963b-e37f5794557d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:13.941126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec692-b11a-45e8-963b-e37f5794557d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:13.941402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec692-b11a-45e8-963b-e37f5794557d None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:13.942175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ec692-b11a-45e8-963b-e37f5794557d None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:13.942504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ec692-b11a-45e8-963b-e37f5794557d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:13.943957 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ec692-b11a-45e8-963b-e37f5794557d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:13.956194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 195/384] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:13.964144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc1266-f1f9-4998-b177-53b06bf81039 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:14.094846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc1266-f1f9-4998-b177-53b06bf81039 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:14.142525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121283a-f71c-4c5b-932d-31a0db4b1f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:14.143400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121283a-f71c-4c5b-932d-31a0db4b1f05 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:14.143683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121283a-f71c-4c5b-932d-31a0db4b1f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:14.143959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121283a-f71c-4c5b-932d-31a0db4b1f05 None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:14.145168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121283a-f71c-4c5b-932d-31a0db4b1f05 None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:14.146660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121283a-f71c-4c5b-932d-31a0db4b1f05 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:14.148707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 190/385] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:13 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:14.154466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ec692-b11a-45e8-963b-e37f5794557d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:14.273902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ec692-b11a-45e8-963b-e37f5794557d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:14.315969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824673c9-fde2-42c3-a29a-a0f2c3b6773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:14.316840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824673c9-fde2-42c3-a29a-a0f2c3b6773d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:14.317127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824673c9-fde2-42c3-a29a-a0f2c3b6773d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:14.317404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824673c9-fde2-42c3-a29a-a0f2c3b6773d None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:14.318620 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824673c9-fde2-42c3-a29a-a0f2c3b6773d None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:14.320050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824673c9-fde2-42c3-a29a-a0f2c3b6773d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:14.322035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 196/386] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:14 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:14.328081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121283a-f71c-4c5b-932d-31a0db4b1f05 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:14.436574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121283a-f71c-4c5b-932d-31a0db4b1f05 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:14.483881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03bba00-5c96-4c13-937a-6da4166e1b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:14.484777 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bba00-5c96-4c13-937a-6da4166e1b8b None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:14.485116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bba00-5c96-4c13-937a-6da4166e1b8b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:14.485391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03bba00-5c96-4c13-937a-6da4166e1b8b None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/groups/8ae9e88883df49d6bb83b2f883cddddf/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:14.487415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bba00-5c96-4c13-937a-6da4166e1b8b None admin] RBAC: Authorizing `identity:create_grant(project_id=81d9b125a65a40ef8faf3f1791912d0c, group_id=8ae9e88883df49d6bb83b2f883cddddf, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:14.488839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03bba00-5c96-4c13-937a-6da4166e1b8b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:14.505602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 191/387] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 00:12:14 2022] PUT /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/groups/8ae9e88883df49d6bb83b2f883cddddf/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:14.651732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f1132-6043-4c4b-b4a2-f51629b2fdb1 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:14.652108 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f1132-6043-4c4b-b4a2-f51629b2fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:14.652281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f1132-6043-4c4b-b4a2-f51629b2fdb1 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:14.656852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 197/388] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:14.661043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659e266-1ec7-409c-9fc4-68345c3a6bc1 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:14.661334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659e266-1ec7-409c-9fc4-68345c3a6bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:14.661649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659e266-1ec7-409c-9fc4-68345c3a6bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:14.687318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0659e266-1ec7-409c-9fc4-68345c3a6bc1 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:14.688495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0659e266-1ec7-409c-9fc4-68345c3a6bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:14.777148 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 192/389] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:14.802278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f1132-6043-4c4b-b4a2-f51629b2fdb1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:14.926920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f1132-6043-4c4b-b4a2-f51629b2fdb1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:14.968512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19ab8-f9c3-4e7f-a735-3ff00e69906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:14.969263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19ab8-f9c3-4e7f-a735-3ff00e69906e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:14.969546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19ab8-f9c3-4e7f-a735-3ff00e69906e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:14.969818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a19ab8-f9c3-4e7f-a735-3ff00e69906e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:14.984123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a19ab8-f9c3-4e7f-a735-3ff00e69906e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:14.991785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-06a19ab8-f9c3-4e7f-a735-3ff00e69906e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:12:14.993537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 198/390] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:12:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:15.003339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659e266-1ec7-409c-9fc4-68345c3a6bc1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:15.145258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659e266-1ec7-409c-9fc4-68345c3a6bc1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:15.189690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3f4f8-b872-4b70-89fc-6e88a6525012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:15.190445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f4f8-b872-4b70-89fc-6e88a6525012 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:15.190733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f4f8-b872-4b70-89fc-6e88a6525012 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:15.191012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3f4f8-b872-4b70-89fc-6e88a6525012 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:15.191770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f4f8-b872-4b70-89fc-6e88a6525012 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:15.192076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f4f8-b872-4b70-89fc-6e88a6525012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:15.193451 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3f4f8-b872-4b70-89fc-6e88a6525012 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:15.202581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 193/391] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:15.210066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19ab8-f9c3-4e7f-a735-3ff00e69906e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:15.339498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb437193-76df-4abd-9716-3e8968f450d6 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:15.339998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb437193-76df-4abd-9716-3e8968f450d6 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:15.340526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb437193-76df-4abd-9716-3e8968f450d6 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:15.342035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 194/392] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:15.347188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58638f0-4585-4b87-991c-c0fb994239f2 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:15.347469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58638f0-4585-4b87-991c-c0fb994239f2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:15.347744 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58638f0-4585-4b87-991c-c0fb994239f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:15.354806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a19ab8-f9c3-4e7f-a735-3ff00e69906e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:15.377730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b58638f0-4585-4b87-991c-c0fb994239f2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:15.379379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b58638f0-4585-4b87-991c-c0fb994239f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:15.419684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90738ff1-9fd8-4309-824e-d9912d9a093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:15.420860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90738ff1-9fd8-4309-824e-d9912d9a093f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:15.421321 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90738ff1-9fd8-4309-824e-d9912d9a093f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:15.421771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90738ff1-9fd8-4309-824e-d9912d9a093f None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:15.423178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90738ff1-9fd8-4309-824e-d9912d9a093f None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:15.425837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90738ff1-9fd8-4309-824e-d9912d9a093f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:15.430139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 199/393] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:15 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:15.441378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90738ff1-9fd8-4309-824e-d9912d9a093f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:15.515693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 195/394] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:15.572669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58638f0-4585-4b87-991c-c0fb994239f2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:15.618526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90738ff1-9fd8-4309-824e-d9912d9a093f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:15.695839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f73f1-c761-4a7f-8a0f-c9f060480ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:15.696958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f73f1-c761-4a7f-8a0f-c9f060480ba9 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:15.697412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f73f1-c761-4a7f-8a0f-c9f060480ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:15.697827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f73f1-c761-4a7f-8a0f-c9f060480ba9 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:15.700668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f73f1-c761-4a7f-8a0f-c9f060480ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:15.702242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f73f1-c761-4a7f-8a0f-c9f060480ba9 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:15.706557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 200/395] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:15 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:15.715570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f73f1-c761-4a7f-8a0f-c9f060480ba9 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:15.769905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58638f0-4585-4b87-991c-c0fb994239f2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:15.829699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd1029-4998-48f8-a436-a30e7e748524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:15.830767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd1029-4998-48f8-a436-a30e7e748524 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:15.831190 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd1029-4998-48f8-a436-a30e7e748524 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:15.831703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd1029-4998-48f8-a436-a30e7e748524 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:15.848812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd1029-4998-48f8-a436-a30e7e748524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:15.861351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-b9cd1029-4998-48f8-a436-a30e7e748524 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:12:15.865663 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 196/396] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:15.873562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd1029-4998-48f8-a436-a30e7e748524 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:15.886449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f73f1-c761-4a7f-8a0f-c9f060480ba9 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:15.944680 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab123264-2c8a-43b1-8223-d7091752d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:15.945916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123264-2c8a-43b1-8223-d7091752d929 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:15.946434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123264-2c8a-43b1-8223-d7091752d929 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:15.946878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab123264-2c8a-43b1-8223-d7091752d929 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/groups/8ae9e88883df49d6bb83b2f883cddddf/roles/3950e5fe56724635b0bd65e6d20fcd1d` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:15.953071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123264-2c8a-43b1-8223-d7091752d929 None admin] RBAC: Authorizing `identity:create_grant(project_id=81d9b125a65a40ef8faf3f1791912d0c, group_id=8ae9e88883df49d6bb83b2f883cddddf, role_id=3950e5fe56724635b0bd65e6d20fcd1d)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:15.954864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab123264-2c8a-43b1-8223-d7091752d929 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:15.975602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 201/397] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 00:12:15 2022] PUT /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c/groups/8ae9e88883df49d6bb83b2f883cddddf/roles/3950e5fe56724635b0bd65e6d20fcd1d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:16.024134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd1029-4998-48f8-a436-a30e7e748524 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:16.051846 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b7037-f213-448b-b15c-2208bc226e30 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.052186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b7037-f213-448b-b15c-2208bc226e30 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.052578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b7037-f213-448b-b15c-2208bc226e30 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.054332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 202/398] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:12:16.061016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6767ce-e1d8-42db-824c-bf59c2ad1f76 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.061391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6767ce-e1d8-42db-824c-bf59c2ad1f76 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.061786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6767ce-e1d8-42db-824c-bf59c2ad1f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.065107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821835e-56ba-43d4-8fdd-f5789980595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:16.066114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821835e-56ba-43d4-8fdd-f5789980595a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.066627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821835e-56ba-43d4-8fdd-f5789980595a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.067101 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821835e-56ba-43d4-8fdd-f5789980595a None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.068106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821835e-56ba-43d4-8fdd-f5789980595a None admin] RBAC: Adding query filter params (name=member) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:16.068579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821835e-56ba-43d4-8fdd-f5789980595a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:16.070297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821835e-56ba-43d4-8fdd-f5789980595a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:16.079867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 197/399] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:16.095916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ae6767ce-e1d8-42db-824c-bf59c2ad1f76 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:16.096289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821835e-56ba-43d4-8fdd-f5789980595a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:16.097286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ae6767ce-e1d8-42db-824c-bf59c2ad1f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:16.204716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 203/400] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:12:16.225296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821835e-56ba-43d4-8fdd-f5789980595a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:16.236844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6767ce-e1d8-42db-824c-bf59c2ad1f76 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:16.265386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae956d-c714-4894-a63d-7fbd53f5fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:16.266846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae956d-c714-4894-a63d-7fbd53f5fa3a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.267342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae956d-c714-4894-a63d-7fbd53f5fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.267878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae956d-c714-4894-a63d-7fbd53f5fa3a None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.269570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae956d-c714-4894-a63d-7fbd53f5fa3a None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:16.271454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae956d-c714-4894-a63d-7fbd53f5fa3a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:16.273838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 198/401] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:16 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:16.280290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae956d-c714-4894-a63d-7fbd53f5fa3a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:16.412236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6767ce-e1d8-42db-824c-bf59c2ad1f76 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:16.423440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae956d-c714-4894-a63d-7fbd53f5fa3a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:16.455697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6b1ef-2dc0-4ba4-9a03-98e22629fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:16.457353 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6b1ef-2dc0-4ba4-9a03-98e22629fa61 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.457832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6b1ef-2dc0-4ba4-9a03-98e22629fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.458398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6b1ef-2dc0-4ba4-9a03-98e22629fa61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.461307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30727bd9-1376-4e77-9e4b-617ce6408552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:16.462336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30727bd9-1376-4e77-9e4b-617ce6408552 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.462713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30727bd9-1376-4e77-9e4b-617ce6408552 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.463153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30727bd9-1376-4e77-9e4b-617ce6408552 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.464410 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30727bd9-1376-4e77-9e4b-617ce6408552 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:16.465984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30727bd9-1376-4e77-9e4b-617ce6408552 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:16.468086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 199/402] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:16 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:16.470976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6b1ef-2dc0-4ba4-9a03-98e22629fa61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:16.473728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30727bd9-1376-4e77-9e4b-617ce6408552 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:16.479812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-c0c6b1ef-2dc0-4ba4-9a03-98e22629fa61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:12:16.482020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 204/403] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:12:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:16.488593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6b1ef-2dc0-4ba4-9a03-98e22629fa61 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:16.598877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30727bd9-1376-4e77-9e4b-617ce6408552 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:16.640146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564a44-43b8-40de-b044-73d5e50f5637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:16.641488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564a44-43b8-40de-b044-73d5e50f5637 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.642241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564a44-43b8-40de-b044-73d5e50f5637 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.642749 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63564a44-43b8-40de-b044-73d5e50f5637 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff/groups/8ae9e88883df49d6bb83b2f883cddddf/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.645617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63564a44-43b8-40de-b044-73d5e50f5637 None admin] RBAC: Authorizing `identity:create_grant(project_id=82a354954d4f4effbdd82df1d17d6dff, group_id=8ae9e88883df49d6bb83b2f883cddddf, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:16.647488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63564a44-43b8-40de-b044-73d5e50f5637 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:16.648040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6b1ef-2dc0-4ba4-9a03-98e22629fa61 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:16.666571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 200/404] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 00:12:16 2022] PUT /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff/groups/8ae9e88883df49d6bb83b2f883cddddf/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:12:16.689921 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02615102-6cff-4c2c-af4b-639feda8bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:16.690638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615102-6cff-4c2c-af4b-639feda8bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.690919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615102-6cff-4c2c-af4b-639feda8bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.691192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02615102-6cff-4c2c-af4b-639feda8bdf0 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.692008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02615102-6cff-4c2c-af4b-639feda8bdf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:16.692314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02615102-6cff-4c2c-af4b-639feda8bdf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:16.693780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02615102-6cff-4c2c-af4b-639feda8bdf0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:16.704265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 205/405] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:16.710810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564a44-43b8-40de-b044-73d5e50f5637 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:16.804198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c42805-f1af-4133-9ae6-aa409de359d0 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.804533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c42805-f1af-4133-9ae6-aa409de359d0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.804829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c42805-f1af-4133-9ae6-aa409de359d0 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.806749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 206/406] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:12:16.813041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16d66-e00c-43dc-bd54-dfe9c8f627d8 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.813327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16d66-e00c-43dc-bd54-dfe9c8f627d8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.813618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16d66-e00c-43dc-bd54-dfe9c8f627d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.830182 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63564a44-43b8-40de-b044-73d5e50f5637 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:16.833296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-30e16d66-e00c-43dc-bd54-dfe9c8f627d8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:16.834631 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-30e16d66-e00c-43dc-bd54-dfe9c8f627d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:16.905032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f4c6a-bf7d-4586-ab7d-6e4e7d6cb405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:16.905921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f4c6a-bf7d-4586-ab7d-6e4e7d6cb405 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:16.906210 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f4c6a-bf7d-4586-ab7d-6e4e7d6cb405 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:16.906513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f4c6a-bf7d-4586-ab7d-6e4e7d6cb405 None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:16.908991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 207/407] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:12:16.909711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f4c6a-bf7d-4586-ab7d-6e4e7d6cb405 None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:16.911476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f4c6a-bf7d-4586-ab7d-6e4e7d6cb405 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:16.914145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 201/408] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:16 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:16.919055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e16d66-e00c-43dc-bd54-dfe9c8f627d8 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:16.954891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f4c6a-bf7d-4586-ab7d-6e4e7d6cb405 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:17.037056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e16d66-e00c-43dc-bd54-dfe9c8f627d8 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:17.075709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85d03c-2788-4048-a0b7-cd45bd0ae4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:17.076585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85d03c-2788-4048-a0b7-cd45bd0ae4d2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:17.076868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85d03c-2788-4048-a0b7-cd45bd0ae4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:17.077143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85d03c-2788-4048-a0b7-cd45bd0ae4d2 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:17.078365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85d03c-2788-4048-a0b7-cd45bd0ae4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:17.080278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85d03c-2788-4048-a0b7-cd45bd0ae4d2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:17.082320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 208/409] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:16 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:17.091446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85d03c-2788-4048-a0b7-cd45bd0ae4d2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:17.144415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f4c6a-bf7d-4586-ab7d-6e4e7d6cb405 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:17.202574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85d03c-2788-4048-a0b7-cd45bd0ae4d2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:17.237316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede25f6-988f-413c-a3cb-b0909914f7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:17.238139 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede25f6-988f-413c-a3cb-b0909914f7ed None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:17.238456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede25f6-988f-413c-a3cb-b0909914f7ed None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:17.238735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede25f6-988f-413c-a3cb-b0909914f7ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:17.240206 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b7990-7c8c-4c3c-866a-617792d0a5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:17.241095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b7990-7c8c-4c3c-866a-617792d0a5fc None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:17.241376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b7990-7c8c-4c3c-866a-617792d0a5fc None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:17.241647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b7990-7c8c-4c3c-866a-617792d0a5fc None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff/groups/8ae9e88883df49d6bb83b2f883cddddf/roles/3950e5fe56724635b0bd65e6d20fcd1d` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:17.244554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b7990-7c8c-4c3c-866a-617792d0a5fc None admin] RBAC: Authorizing `identity:create_grant(project_id=82a354954d4f4effbdd82df1d17d6dff, group_id=8ae9e88883df49d6bb83b2f883cddddf, role_id=3950e5fe56724635b0bd65e6d20fcd1d)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:17.246039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b7990-7c8c-4c3c-866a-617792d0a5fc None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:17.271285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede25f6-988f-413c-a3cb-b0909914f7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:17.271640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 209/410] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 00:12:17 2022] PUT /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff/groups/8ae9e88883df49d6bb83b2f883cddddf/roles/3950e5fe56724635b0bd65e6d20fcd1d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:12:17.278233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-6ede25f6-988f-413c-a3cb-b0909914f7ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:12:17.283964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 202/411] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:17.290123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b7990-7c8c-4c3c-866a-617792d0a5fc None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:17.456896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b7990-7c8c-4c3c-866a-617792d0a5fc None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:17.503348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b8626-1be6-4e06-8413-642c14b7df96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:17.504427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b8626-1be6-4e06-8413-642c14b7df96 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:17.504927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b8626-1be6-4e06-8413-642c14b7df96 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:17.505412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b8626-1be6-4e06-8413-642c14b7df96 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:17.506380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b8626-1be6-4e06-8413-642c14b7df96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:17.506881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b8626-1be6-4e06-8413-642c14b7df96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:17.508439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b8626-1be6-4e06-8413-642c14b7df96 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:17.518364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 210/412] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:17.525505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede25f6-988f-413c-a3cb-b0909914f7ed None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:17.639280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede25f6-988f-413c-a3cb-b0909914f7ed None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:17.696036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d458f1-64c7-4ab0-8bbb-211a68fd3edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:17.696907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d458f1-64c7-4ab0-8bbb-211a68fd3edd None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:17.697187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d458f1-64c7-4ab0-8bbb-211a68fd3edd None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:17.697460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d458f1-64c7-4ab0-8bbb-211a68fd3edd None admin] PATH_INFO: `/v3/groups/9d304832a7ff4b209aaa204057255e4a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:17.702952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d458f1-64c7-4ab0-8bbb-211a68fd3edd None admin] RBAC: Authorizing `identity:get_group(group_id=9d304832a7ff4b209aaa204057255e4a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:17.704420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d458f1-64c7-4ab0-8bbb-211a68fd3edd None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:17.706438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 203/413] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:17 2022] GET /identity/v3/groups/9d304832a7ff4b209aaa204057255e4a => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:17.712472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b8626-1be6-4e06-8413-642c14b7df96 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:17.846513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b8626-1be6-4e06-8413-642c14b7df96 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:17.873968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116451d0-a12a-4aa6-a6bf-0e6c188bd804 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:17.874331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116451d0-a12a-4aa6-a6bf-0e6c188bd804 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:17.874557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116451d0-a12a-4aa6-a6bf-0e6c188bd804 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:17.878409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 204/414] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:17.885351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabbe5a-cf99-4a65-a7bf-e3d097055924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:17.886222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabbe5a-cf99-4a65-a7bf-e3d097055924 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:17.886586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabbe5a-cf99-4a65-a7bf-e3d097055924 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:17.886867 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabbe5a-cf99-4a65-a7bf-e3d097055924 None admin] PATH_INFO: `/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:17.887821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd8b20-c65f-4860-9a36-1e70acf43d0e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:17.888116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd8b20-c65f-4860-9a36-1e70acf43d0e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:17.888396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd8b20-c65f-4860-9a36-1e70acf43d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:17.888584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabbe5a-cf99-4a65-a7bf-e3d097055924 None admin] RBAC: Authorizing `identity:get_project(project_id=fd9f2f2aa4034c3fa25d211a3bd7ce30)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:17.890181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabbe5a-cf99-4a65-a7bf-e3d097055924 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:17.892132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 211/415] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:17 2022] GET /identity/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:17.899621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabbe5a-cf99-4a65-a7bf-e3d097055924 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:17.921058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b2cd8b20-c65f-4860-9a36-1e70acf43d0e None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:17.922265 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b2cd8b20-c65f-4860-9a36-1e70acf43d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:18.032193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabbe5a-cf99-4a65-a7bf-e3d097055924 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:18.068797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f6256-19d8-407d-9102-9348bdd74d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:18.069679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f6256-19d8-407d-9102-9348bdd74d79 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:18.069959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f6256-19d8-407d-9102-9348bdd74d79 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:18.070231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f6256-19d8-407d-9102-9348bdd74d79 None admin] PATH_INFO: `/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30/groups/9d304832a7ff4b209aaa204057255e4a/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:18.071609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 205/416] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:18.072465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f6256-19d8-407d-9102-9348bdd74d79 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd9f2f2aa4034c3fa25d211a3bd7ce30, group_id=9d304832a7ff4b209aaa204057255e4a, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:18.073879 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f6256-19d8-407d-9102-9348bdd74d79 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:18.093247 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 212/417] 10.222.0.32 () {58 vars in 1442 bytes} [Tue Apr 12 00:12:17 2022] PUT /identity/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30/groups/9d304832a7ff4b209aaa204057255e4a/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:12:18.117853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd8b20-c65f-4860-9a36-1e70acf43d0e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:18.257392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd8b20-c65f-4860-9a36-1e70acf43d0e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:18.304788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925abc50-173a-42ac-b50f-8e4440186131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:18.305602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925abc50-173a-42ac-b50f-8e4440186131 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:18.305887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925abc50-173a-42ac-b50f-8e4440186131 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:18.306147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925abc50-173a-42ac-b50f-8e4440186131 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:18.327494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925abc50-173a-42ac-b50f-8e4440186131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:18.334668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-925abc50-173a-42ac-b50f-8e4440186131 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:12:18.336940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 206/418] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:18.342851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f6256-19d8-407d-9102-9348bdd74d79 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:18.506440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f6256-19d8-407d-9102-9348bdd74d79 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:18.552062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac09b2-f69b-429a-8371-01cda17fe7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:18.552659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac09b2-f69b-429a-8371-01cda17fe7ec None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:18.552939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac09b2-f69b-429a-8371-01cda17fe7ec None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:18.553215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac09b2-f69b-429a-8371-01cda17fe7ec None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:18.554026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac09b2-f69b-429a-8371-01cda17fe7ec None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:18.554401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac09b2-f69b-429a-8371-01cda17fe7ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:18.555757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac09b2-f69b-429a-8371-01cda17fe7ec None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:18.566428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 213/419] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:18.571841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925abc50-173a-42ac-b50f-8e4440186131 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:18.709092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925abc50-173a-42ac-b50f-8e4440186131 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:18.758947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895576-346f-4cd8-b0e9-b88f9ccd456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:18.759609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895576-346f-4cd8-b0e9-b88f9ccd456e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:18.759894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895576-346f-4cd8-b0e9-b88f9ccd456e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:18.760170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6895576-346f-4cd8-b0e9-b88f9ccd456e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:18.850038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6895576-346f-4cd8-b0e9-b88f9ccd456e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:18.851442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6895576-346f-4cd8-b0e9-b88f9ccd456e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:18.956397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 207/420] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:18.962029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac09b2-f69b-429a-8371-01cda17fe7ec None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:19.117853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac09b2-f69b-429a-8371-01cda17fe7ec None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:19.162778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073c320-d96e-4cf6-9900-282283aebe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:19.163647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c320-d96e-4cf6-9900-282283aebe2e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:19.163932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c320-d96e-4cf6-9900-282283aebe2e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:19.164470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073c320-d96e-4cf6-9900-282283aebe2e None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:19.170983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073c320-d96e-4cf6-9900-282283aebe2e None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:19.172428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073c320-d96e-4cf6-9900-282283aebe2e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:19.174534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 214/421] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:18 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:19.179759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895576-346f-4cd8-b0e9-b88f9ccd456e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:19.248249 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281412c-2dec-4c85-816e-6875d61598ed None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:19.248899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281412c-2dec-4c85-816e-6875d61598ed None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:19.249368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281412c-2dec-4c85-816e-6875d61598ed None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:19.251215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 215/422] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:12:19.256352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd0570-1420-4d7d-a5b9-72b679df6045 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:19.256873 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd0570-1420-4d7d-a5b9-72b679df6045 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:19.257345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd0570-1420-4d7d-a5b9-72b679df6045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:19.300492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-7bdd0570-1420-4d7d-a5b9-72b679df6045 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:19.301995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7bdd0570-1420-4d7d-a5b9-72b679df6045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:19.309501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6895576-346f-4cd8-b0e9-b88f9ccd456e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:19.342228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d7fa-9f79-4ed2-adef-b14a9d080282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:19.343898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d7fa-9f79-4ed2-adef-b14a9d080282 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:19.344179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d7fa-9f79-4ed2-adef-b14a9d080282 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:19.344453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d7fa-9f79-4ed2-adef-b14a9d080282 None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:19.347644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d7fa-9f79-4ed2-adef-b14a9d080282 None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:19.349077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d7fa-9f79-4ed2-adef-b14a9d080282 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:19.350718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 208/423] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:19 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:19.359133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d7fa-9f79-4ed2-adef-b14a9d080282 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:19.397097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 216/424] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:12:19.426056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd0570-1420-4d7d-a5b9-72b679df6045 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:19.550227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d7fa-9f79-4ed2-adef-b14a9d080282 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:19.594562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd0570-1420-4d7d-a5b9-72b679df6045 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:19.615485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d38d1-92a7-400e-b4cb-d88d0a890ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:19.616153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d38d1-92a7-400e-b4cb-d88d0a890ef9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:19.616438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d38d1-92a7-400e-b4cb-d88d0a890ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:19.616715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d38d1-92a7-400e-b4cb-d88d0a890ef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:19.617557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d38d1-92a7-400e-b4cb-d88d0a890ef9 None admin] RBAC: Adding query filter params (group.id=8ae9e88883df49d6bb83b2f883cddddf, role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:19.617869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d38d1-92a7-400e-b4cb-d88d0a890ef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:19.619324 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d38d1-92a7-400e-b4cb-d88d0a890ef9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:19.634147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 209/425] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:19 2022] GET /identity/v3/role_assignments?group.id=8ae9e88883df49d6bb83b2f883cddddf&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 611 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:19.654107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c378a47-ca1e-4b2f-8cbc-7f85ce56db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:19.654913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c378a47-ca1e-4b2f-8cbc-7f85ce56db51 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:19.655200 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c378a47-ca1e-4b2f-8cbc-7f85ce56db51 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:19.655474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c378a47-ca1e-4b2f-8cbc-7f85ce56db51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:19.672841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c378a47-ca1e-4b2f-8cbc-7f85ce56db51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:19.680477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2c378a47-ca1e-4b2f-8cbc-7f85ce56db51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:12:19.681739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 217/426] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:12:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:19.688385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d38d1-92a7-400e-b4cb-d88d0a890ef9 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:19.826608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d38d1-92a7-400e-b4cb-d88d0a890ef9 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:19.864492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87a6353-c7af-4dce-a015-642c7266e677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:19.865551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a6353-c7af-4dce-a015-642c7266e677 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:19.866031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a6353-c7af-4dce-a015-642c7266e677 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:19.866624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a6353-c7af-4dce-a015-642c7266e677 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:19.867606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a6353-c7af-4dce-a015-642c7266e677 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:19.868116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a6353-c7af-4dce-a015-642c7266e677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:19.869682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87a6353-c7af-4dce-a015-642c7266e677 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:19.880289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 210/427] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:19.886022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c378a47-ca1e-4b2f-8cbc-7f85ce56db51 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:19.987983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3803f8-6ef3-4be1-a3df-e8abce560a16 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:19.988625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3803f8-6ef3-4be1-a3df-e8abce560a16 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:19.989127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3803f8-6ef3-4be1-a3df-e8abce560a16 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:19.990957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 211/428] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:19.995133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c378a47-ca1e-4b2f-8cbc-7f85ce56db51 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:19.997596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ff278-7d80-4a75-993a-3769b7e138ca None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:19.998092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ff278-7d80-4a75-993a-3769b7e138ca None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:19.998609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ff278-7d80-4a75-993a-3769b7e138ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.017722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-bc8ff278-7d80-4a75-993a-3769b7e138ca None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:20.019279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bc8ff278-7d80-4a75-993a-3769b7e138ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:20.032907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a0ca-eeb7-4378-9195-daf0115effcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:20.033724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a0ca-eeb7-4378-9195-daf0115effcd None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.034012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a0ca-eeb7-4378-9195-daf0115effcd None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.034314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a0ca-eeb7-4378-9195-daf0115effcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.092379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 212/429] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:12:20.111930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9a0ca-eeb7-4378-9195-daf0115effcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:20.113387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9a0ca-eeb7-4378-9195-daf0115effcd None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:20.119119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ff278-7d80-4a75-993a-3769b7e138ca None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.220337 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ff278-7d80-4a75-993a-3769b7e138ca None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:20.223546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 218/430] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:20.224903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585eedf-162a-431f-b1b5-7b9b5ae5c50b None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.225192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585eedf-162a-431f-b1b5-7b9b5ae5c50b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.225468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585eedf-162a-431f-b1b5-7b9b5ae5c50b None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.230347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 219/431] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:20.232869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f83751-69f4-470f-bc12-7f9d9a48689b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.233156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f83751-69f4-470f-bc12-7f9d9a48689b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.233436 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f83751-69f4-470f-bc12-7f9d9a48689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.253411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a1f83751-69f4-470f-bc12-7f9d9a48689b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:20.254924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a1f83751-69f4-470f-bc12-7f9d9a48689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:20.257607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8518-0cdb-41e7-9048-7df1802240c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:20.258452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8518-0cdb-41e7-9048-7df1802240c6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.259362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8518-0cdb-41e7-9048-7df1802240c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.259362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8518-0cdb-41e7-9048-7df1802240c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.269966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f8518-0cdb-41e7-9048-7df1802240c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:20.277104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-049f8518-0cdb-41e7-9048-7df1802240c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 12 00:12:20.278849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 213/432] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:20.279641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8518-0cdb-41e7-9048-7df1802240c6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.336804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 220/433] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:20.338283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f83751-69f4-470f-bc12-7f9d9a48689b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.380230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8518-0cdb-41e7-9048-7df1802240c6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:20.417723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0f2d-f78c-4ca1-8e6d-f62774bec183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:20.419134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0f2d-f78c-4ca1-8e6d-f62774bec183 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.419416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0f2d-f78c-4ca1-8e6d-f62774bec183 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.419687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e0f2d-f78c-4ca1-8e6d-f62774bec183 None admin] PATH_INFO: `/v3/projects/81d9b125a65a40ef8faf3f1791912d0c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.420879 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e0f2d-f78c-4ca1-8e6d-f62774bec183 None admin] RBAC: Authorizing `identity:get_project(project_id=81d9b125a65a40ef8faf3f1791912d0c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:20.422347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e0f2d-f78c-4ca1-8e6d-f62774bec183 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:20.424029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 214/434] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/projects/81d9b125a65a40ef8faf3f1791912d0c => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:20.424778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0f2d-f78c-4ca1-8e6d-f62774bec183 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.450307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f83751-69f4-470f-bc12-7f9d9a48689b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:20.484060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8653c-e208-4c62-9745-89a594e4e6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:20.485012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8653c-e208-4c62-9745-89a594e4e6f9 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.485472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8653c-e208-4c62-9745-89a594e4e6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.485951 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8653c-e208-4c62-9745-89a594e4e6f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.486898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8653c-e208-4c62-9745-89a594e4e6f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:20.487391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8653c-e208-4c62-9745-89a594e4e6f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:20.488744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8653c-e208-4c62-9745-89a594e4e6f9 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:20.502653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 221/435] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:20.502653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8653c-e208-4c62-9745-89a594e4e6f9 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.520609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e0f2d-f78c-4ca1-8e6d-f62774bec183 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:20.555466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eda26-810a-4c67-baca-a21ea87641d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:20.556298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eda26-810a-4c67-baca-a21ea87641d2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.556582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eda26-810a-4c67-baca-a21ea87641d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.556858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76eda26-810a-4c67-baca-a21ea87641d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.567784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76eda26-810a-4c67-baca-a21ea87641d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:20.575192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-c76eda26-810a-4c67-baca-a21ea87641d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:12:20.580916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 215/436] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:20.580916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eda26-810a-4c67-baca-a21ea87641d2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.603731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8653c-e208-4c62-9745-89a594e4e6f9 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:20.636468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb783ac-4f9c-42d0-bf9f-d5a7d5e418ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:20.637367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb783ac-4f9c-42d0-bf9f-d5a7d5e418ed None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.637650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb783ac-4f9c-42d0-bf9f-d5a7d5e418ed None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.637925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb783ac-4f9c-42d0-bf9f-d5a7d5e418ed None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.639202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb783ac-4f9c-42d0-bf9f-d5a7d5e418ed None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:20.640638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb783ac-4f9c-42d0-bf9f-d5a7d5e418ed None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:20.646937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 222/437] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:20.646937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb783ac-4f9c-42d0-bf9f-d5a7d5e418ed None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.681119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76eda26-810a-4c67-baca-a21ea87641d2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:20.713320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3687c-4403-4010-bf32-87af3f7fff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:20.713963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3687c-4403-4010-bf32-87af3f7fff99 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.714280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3687c-4403-4010-bf32-87af3f7fff99 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.714554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3687c-4403-4010-bf32-87af3f7fff99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.747388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb783ac-4f9c-42d0-bf9f-d5a7d5e418ed None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:20.779678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabdcc2-c79c-48ab-bc27-19a4cc5d6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:20.779999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3687c-4403-4010-bf32-87af3f7fff99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:20.780268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabdcc2-c79c-48ab-bc27-19a4cc5d6af2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.780546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabdcc2-c79c-48ab-bc27-19a4cc5d6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.780818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabdcc2-c79c-48ab-bc27-19a4cc5d6af2 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.781435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3687c-4403-4010-bf32-87af3f7fff99 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:20.781592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabdcc2-c79c-48ab-bc27-19a4cc5d6af2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:20.781856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabdcc2-c79c-48ab-bc27-19a4cc5d6af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:20.783225 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabdcc2-c79c-48ab-bc27-19a4cc5d6af2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:20.795916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 223/438] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:20.795916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabdcc2-c79c-48ab-bc27-19a4cc5d6af2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.883083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 216/439] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:20.884010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3687c-4403-4010-bf32-87af3f7fff99 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.900427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabdcc2-c79c-48ab-bc27-19a4cc5d6af2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:20.935847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6388c-4e8a-43a4-afc9-5053db9b602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:20.936508 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6388c-4e8a-43a4-afc9-5053db9b602e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:20.936785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6388c-4e8a-43a4-afc9-5053db9b602e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:20.937056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e6388c-4e8a-43a4-afc9-5053db9b602e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:20.937882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6388c-4e8a-43a4-afc9-5053db9b602e None admin] RBAC: Adding query filter params (group.id=8ae9e88883df49d6bb83b2f883cddddf, role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=81d9b125a65a40ef8faf3f1791912d0c) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:20.938187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6388c-4e8a-43a4-afc9-5053db9b602e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:20.939656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e6388c-4e8a-43a4-afc9-5053db9b602e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:20.945275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 224/440] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/role_assignments?group.id=8ae9e88883df49d6bb83b2f883cddddf&scope.project.id=81d9b125a65a40ef8faf3f1791912d0c&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:20.946044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6388c-4e8a-43a4-afc9-5053db9b602e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:20.981412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3687c-4403-4010-bf32-87af3f7fff99 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:21.031894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c176d0-5e29-4448-9bf4-6cda67e4fb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:21.032469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c176d0-5e29-4448-9bf4-6cda67e4fb56 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.032752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c176d0-5e29-4448-9bf4-6cda67e4fb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.033022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c176d0-5e29-4448-9bf4-6cda67e4fb56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.065244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e6388c-4e8a-43a4-afc9-5053db9b602e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:21.104789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729292ec-46cc-4743-8921-1e32ed242622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:21.105271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c176d0-5e29-4448-9bf4-6cda67e4fb56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:21.106187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729292ec-46cc-4743-8921-1e32ed242622 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.106495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729292ec-46cc-4743-8921-1e32ed242622 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.106762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729292ec-46cc-4743-8921-1e32ed242622 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.108007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729292ec-46cc-4743-8921-1e32ed242622 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:21.108263 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c176d0-5e29-4448-9bf4-6cda67e4fb56 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:21.109554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729292ec-46cc-4743-8921-1e32ed242622 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:21.111322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 225/441] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:21.112573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebce0de-9b5c-4416-aa22-dcb4daf44959 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.112855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebce0de-9b5c-4416-aa22-dcb4daf44959 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.113123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebce0de-9b5c-4416-aa22-dcb4daf44959 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.114555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 226/442] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:21.119194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebce0de-9b5c-4416-aa22-dcb4daf44959 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:21.227615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 217/443] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:21.230912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e454ab5-43fc-4955-827c-949cd52b23c6 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.230912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e454ab5-43fc-4955-827c-949cd52b23c6 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.230912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e454ab5-43fc-4955-827c-949cd52b23c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.234399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebce0de-9b5c-4416-aa22-dcb4daf44959 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:21.248544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6e454ab5-43fc-4955-827c-949cd52b23c6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:21.250825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6e454ab5-43fc-4955-827c-949cd52b23c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:21.280151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510567-26f2-4015-a08e-2a6e0ef0ae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:21.281018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510567-26f2-4015-a08e-2a6e0ef0ae7f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.281296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510567-26f2-4015-a08e-2a6e0ef0ae7f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.281569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1510567-26f2-4015-a08e-2a6e0ef0ae7f None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.282995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1510567-26f2-4015-a08e-2a6e0ef0ae7f None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:21.286700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1510567-26f2-4015-a08e-2a6e0ef0ae7f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:21.286818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 227/444] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:21 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:21.288666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510567-26f2-4015-a08e-2a6e0ef0ae7f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:21.329725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 218/445] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:21.330761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e454ab5-43fc-4955-827c-949cd52b23c6 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:21.410503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1510567-26f2-4015-a08e-2a6e0ef0ae7f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:21.431871 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e454ab5-43fc-4955-827c-949cd52b23c6 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:21.443852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bf2b4-531a-4f7c-9311-098dcb837810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:21.444666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf2b4-531a-4f7c-9311-098dcb837810 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.444947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf2b4-531a-4f7c-9311-098dcb837810 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.445224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26bf2b4-531a-4f7c-9311-098dcb837810 None admin] PATH_INFO: `/v3/projects/82a354954d4f4effbdd82df1d17d6dff` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.446448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bf2b4-531a-4f7c-9311-098dcb837810 None admin] RBAC: Authorizing `identity:get_project(project_id=82a354954d4f4effbdd82df1d17d6dff)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:21.447880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26bf2b4-531a-4f7c-9311-098dcb837810 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:21.449583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 228/446] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:21 2022] GET /identity/v3/projects/82a354954d4f4effbdd82df1d17d6dff => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:21.450559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bf2b4-531a-4f7c-9311-098dcb837810 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:21.467225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827ecfb-1eb7-40f1-ba3a-b2ebdd27e73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:21.467879 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ecfb-1eb7-40f1-ba3a-b2ebdd27e73f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.468161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ecfb-1eb7-40f1-ba3a-b2ebdd27e73f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.468461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827ecfb-1eb7-40f1-ba3a-b2ebdd27e73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.469246 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827ecfb-1eb7-40f1-ba3a-b2ebdd27e73f None admin] RBAC: Adding query filter params (group.id=8ae9e88883df49d6bb83b2f883cddddf, role.id=7277e8dc4e284e59a5f04f5183b5c341, scope.project.id=82a354954d4f4effbdd82df1d17d6dff) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:21.469551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827ecfb-1eb7-40f1-ba3a-b2ebdd27e73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:21.470984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827ecfb-1eb7-40f1-ba3a-b2ebdd27e73f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:21.476806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 219/447] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:21 2022] GET /identity/v3/role_assignments?group.id=8ae9e88883df49d6bb83b2f883cddddf&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=7277e8dc4e284e59a5f04f5183b5c341 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:21.477428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827ecfb-1eb7-40f1-ba3a-b2ebdd27e73f None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:21.595678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26bf2b4-531a-4f7c-9311-098dcb837810 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:21.601484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827ecfb-1eb7-40f1-ba3a-b2ebdd27e73f None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:21.647481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114add4-f070-404f-a9ac-3e501f868824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:21.648307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114add4-f070-404f-a9ac-3e501f868824 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.648585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114add4-f070-404f-a9ac-3e501f868824 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.648859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114add4-f070-404f-a9ac-3e501f868824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.653486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17338dce-c9f9-48c5-b422-b39207cb428b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:21.654391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17338dce-c9f9-48c5-b422-b39207cb428b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.654797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17338dce-c9f9-48c5-b422-b39207cb428b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.655078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17338dce-c9f9-48c5-b422-b39207cb428b None admin] PATH_INFO: `/v3/groups/8ae9e88883df49d6bb83b2f883cddddf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.658604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17338dce-c9f9-48c5-b422-b39207cb428b None admin] RBAC: Authorizing `identity:get_group(group_id=8ae9e88883df49d6bb83b2f883cddddf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:21.660076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17338dce-c9f9-48c5-b422-b39207cb428b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:21.662812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 220/448] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:21 2022] GET /identity/v3/groups/8ae9e88883df49d6bb83b2f883cddddf => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:21.669034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17338dce-c9f9-48c5-b422-b39207cb428b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:21.675664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114add4-f070-404f-a9ac-3e501f868824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:21.683100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-e114add4-f070-404f-a9ac-3e501f868824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:12:21.684976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 229/449] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:21.690183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114add4-f070-404f-a9ac-3e501f868824 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:21.811492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17338dce-c9f9-48c5-b422-b39207cb428b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:21.840929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114add4-f070-404f-a9ac-3e501f868824 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:21.859189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49868a66-fca4-45cd-9b17-c029e77ff0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:21.859776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49868a66-fca4-45cd-9b17-c029e77ff0cf None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.860053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49868a66-fca4-45cd-9b17-c029e77ff0cf None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.860323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49868a66-fca4-45cd-9b17-c029e77ff0cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.861434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49868a66-fca4-45cd-9b17-c029e77ff0cf None admin] RBAC: Adding query filter params (group.id=8ae9e88883df49d6bb83b2f883cddddf, role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=82a354954d4f4effbdd82df1d17d6dff) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:21.861434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49868a66-fca4-45cd-9b17-c029e77ff0cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:21.863980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49868a66-fca4-45cd-9b17-c029e77ff0cf None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:21.874026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 221/450] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:21 2022] GET /identity/v3/role_assignments?group.id=8ae9e88883df49d6bb83b2f883cddddf&scope.project.id=82a354954d4f4effbdd82df1d17d6dff&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:21.891740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373a36-a8a6-4874-b8e5-e514910ac80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:21.892704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373a36-a8a6-4874-b8e5-e514910ac80a None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:21.892983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373a36-a8a6-4874-b8e5-e514910ac80a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:21.893257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a373a36-a8a6-4874-b8e5-e514910ac80a None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:21.894028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a373a36-a8a6-4874-b8e5-e514910ac80a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:21.894459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a373a36-a8a6-4874-b8e5-e514910ac80a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:21.895843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a373a36-a8a6-4874-b8e5-e514910ac80a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:21.905868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 230/451] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:21.913084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49868a66-fca4-45cd-9b17-c029e77ff0cf None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:22.021309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49868a66-fca4-45cd-9b17-c029e77ff0cf None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:22.056781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de5e27-be94-4a40-aedf-c705e660f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:22.057439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5e27-be94-4a40-aedf-c705e660f9af None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:22.057735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5e27-be94-4a40-aedf-c705e660f9af None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:22.058010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de5e27-be94-4a40-aedf-c705e660f9af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:22.131329 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de5e27-be94-4a40-aedf-c705e660f9af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:22.133787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de5e27-be94-4a40-aedf-c705e660f9af None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:22.237563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 222/452] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:22.243614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373a36-a8a6-4874-b8e5-e514910ac80a None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:22.344973 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a373a36-a8a6-4874-b8e5-e514910ac80a None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:22.377303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a982e9-cea9-4df7-8cbe-af1a972cb46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:22.378177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a982e9-cea9-4df7-8cbe-af1a972cb46e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:22.378495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a982e9-cea9-4df7-8cbe-af1a972cb46e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:22.378772 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a982e9-cea9-4df7-8cbe-af1a972cb46e None admin] PATH_INFO: `/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:22.379949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a982e9-cea9-4df7-8cbe-af1a972cb46e None admin] RBAC: Authorizing `identity:get_project(project_id=fd9f2f2aa4034c3fa25d211a3bd7ce30)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:22.381420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a982e9-cea9-4df7-8cbe-af1a972cb46e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:22.383104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 231/453] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:12:22 2022] GET /identity/v3/projects/fd9f2f2aa4034c3fa25d211a3bd7ce30 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:22.388664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de5e27-be94-4a40-aedf-c705e660f9af None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:22.485186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de5e27-be94-4a40-aedf-c705e660f9af None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:22.517790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72309c08-c29c-483f-be48-f1940e084c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:22.518685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72309c08-c29c-483f-be48-f1940e084c1b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:22.518964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72309c08-c29c-483f-be48-f1940e084c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:22.519245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72309c08-c29c-483f-be48-f1940e084c1b None admin] PATH_INFO: `/v3/groups/9d304832a7ff4b209aaa204057255e4a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:22.520417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72309c08-c29c-483f-be48-f1940e084c1b None admin] RBAC: Authorizing `identity:get_group(group_id=9d304832a7ff4b209aaa204057255e4a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:22.521863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72309c08-c29c-483f-be48-f1940e084c1b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:22.523503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 223/454] 10.222.0.32 () {56 vars in 1180 bytes} [Tue Apr 12 00:12:22 2022] GET /identity/v3/groups/9d304832a7ff4b209aaa204057255e4a => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:22.529482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a982e9-cea9-4df7-8cbe-af1a972cb46e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:22.627010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a982e9-cea9-4df7-8cbe-af1a972cb46e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:22.662094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66616498-a71c-477d-be42-38359bbeee04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:22.663139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66616498-a71c-477d-be42-38359bbeee04 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:22.663416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66616498-a71c-477d-be42-38359bbeee04 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:22.663686 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66616498-a71c-477d-be42-38359bbeee04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:22.664772 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66616498-a71c-477d-be42-38359bbeee04 None admin] RBAC: Adding query filter params (group.id=9d304832a7ff4b209aaa204057255e4a, role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=fd9f2f2aa4034c3fa25d211a3bd7ce30) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:22.665077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66616498-a71c-477d-be42-38359bbeee04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:22.666531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66616498-a71c-477d-be42-38359bbeee04 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:22.672545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 232/455] 10.222.0.32 () {56 vars in 1376 bytes} [Tue Apr 12 00:12:22 2022] GET /identity/v3/role_assignments?group.id=9d304832a7ff4b209aaa204057255e4a&scope.project.id=fd9f2f2aa4034c3fa25d211a3bd7ce30&role.id=f0208c43117c4b799194c83781a46e09 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:25.838524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eff88e-3f77-4d9d-9abd-cc9df1f4cffc None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:25.838524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eff88e-3f77-4d9d-9abd-cc9df1f4cffc None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:25.838524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eff88e-3f77-4d9d-9abd-cc9df1f4cffc None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:25.838524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 224/456] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:25.845429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a7f1-0ac1-4293-944d-9c1c1b6dc271 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:25.846192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a7f1-0ac1-4293-944d-9c1c1b6dc271 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:25.846650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a7f1-0ac1-4293-944d-9c1c1b6dc271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:25.868231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e766a7f1-0ac1-4293-944d-9c1c1b6dc271 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:25.869576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e766a7f1-0ac1-4293-944d-9c1c1b6dc271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:25.965429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 233/457] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:26.006478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eff88e-3f77-4d9d-9abd-cc9df1f4cffc None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:26.117396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7ef88-d935-4adc-b1c9-37d5c12b3652 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.118032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7ef88-d935-4adc-b1c9-37d5c12b3652 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.118556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7ef88-d935-4adc-b1c9-37d5c12b3652 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.120121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 234/458] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:12:26.127059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980b08c-54cc-41a7-85b2-377d085c7c3e None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.127608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980b08c-54cc-41a7-85b2-377d085c7c3e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.128089 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980b08c-54cc-41a7-85b2-377d085c7c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.156963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eff88e-3f77-4d9d-9abd-cc9df1f4cffc None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:26.169762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-6980b08c-54cc-41a7-85b2-377d085c7c3e None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:26.171324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6980b08c-54cc-41a7-85b2-377d085c7c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:26.213637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95089f-45c7-485c-9a25-0e0229bc916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:26.214633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95089f-45c7-485c-9a25-0e0229bc916e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.215164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95089f-45c7-485c-9a25-0e0229bc916e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.215693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95089f-45c7-485c-9a25-0e0229bc916e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.235044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95089f-45c7-485c-9a25-0e0229bc916e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:26.237506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95089f-45c7-485c-9a25-0e0229bc916e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:26.266197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-9a95089f-45c7-485c-9a25-0e0229bc916e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:26.272803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 225/459] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:26.274524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690588ed-7eac-44c7-8531-f7cc8f4884d4 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.275158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690588ed-7eac-44c7-8531-f7cc8f4884d4 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.275642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690588ed-7eac-44c7-8531-f7cc8f4884d4 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.277590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 226/460] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:26.278579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690588ed-7eac-44c7-8531-f7cc8f4884d4 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:26.288605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 235/461] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:26.290704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2db1d6-b1ca-44a7-9a0c-5003f45ddd7d None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.290704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2db1d6-b1ca-44a7-9a0c-5003f45ddd7d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.290704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2db1d6-b1ca-44a7-9a0c-5003f45ddd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.309779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-db2db1d6-b1ca-44a7-9a0c-5003f45ddd7d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:26.311001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-db2db1d6-b1ca-44a7-9a0c-5003f45ddd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:26.393352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 236/462] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:26.394157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2db1d6-b1ca-44a7-9a0c-5003f45ddd7d None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:26.519059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690588ed-7eac-44c7-8531-f7cc8f4884d4 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:26.540945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2db1d6-b1ca-44a7-9a0c-5003f45ddd7d None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:26.577784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a0eec-5a0f-42a3-8240-8e2958e34185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:26.578968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a0eec-5a0f-42a3-8240-8e2958e34185 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.579360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a0eec-5a0f-42a3-8240-8e2958e34185 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.579645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a0eec-5a0f-42a3-8240-8e2958e34185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.580715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7de0f5-79a5-46c1-9570-b02887131ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:26.581394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7de0f5-79a5-46c1-9570-b02887131ae5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.582677 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7de0f5-79a5-46c1-9570-b02887131ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.582977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7de0f5-79a5-46c1-9570-b02887131ae5 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.583717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7de0f5-79a5-46c1-9570-b02887131ae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:26.584025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7de0f5-79a5-46c1-9570-b02887131ae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:26.585493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7de0f5-79a5-46c1-9570-b02887131ae5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:26.591465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a0eec-5a0f-42a3-8240-8e2958e34185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:26.592920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a0eec-5a0f-42a3-8240-8e2958e34185 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:26.602004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 227/463] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:26.606086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7de0f5-79a5-46c1-9570-b02887131ae5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:26.614664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-cc7a0eec-5a0f-42a3-8240-8e2958e34185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:26.617984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 237/464] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:26.619831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a0eec-5a0f-42a3-8240-8e2958e34185 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:26.736411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a0eec-5a0f-42a3-8240-8e2958e34185 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:26.779799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1dcae-d98e-499a-a849-c81892c2cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:26.780857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1dcae-d98e-499a-a849-c81892c2cced None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.781344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1dcae-d98e-499a-a849-c81892c2cced None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.781841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1dcae-d98e-499a-a849-c81892c2cced None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.782816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1dcae-d98e-499a-a849-c81892c2cced None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:26.783511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7de0f5-79a5-46c1-9570-b02887131ae5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:26.784684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1dcae-d98e-499a-a849-c81892c2cced None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:26.809245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 238/465] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:12:26 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:26.811053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1dcae-d98e-499a-a849-c81892c2cced None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:26.844348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61004095-82a9-428b-9e72-9fa53999430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:26.846205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61004095-82a9-428b-9e72-9fa53999430e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.846723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61004095-82a9-428b-9e72-9fa53999430e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.847176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61004095-82a9-428b-9e72-9fa53999430e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.867918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61004095-82a9-428b-9e72-9fa53999430e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:26.869666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61004095-82a9-428b-9e72-9fa53999430e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:26.895870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-61004095-82a9-428b-9e72-9fa53999430e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:26.898213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 228/466] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:26.900188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a7350-f85a-444d-b245-27f153099632 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.902082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a7350-f85a-444d-b245-27f153099632 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.902745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a7350-f85a-444d-b245-27f153099632 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.904839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 229/467] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:26.905853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a7350-f85a-444d-b245-27f153099632 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:26.988919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1dcae-d98e-499a-a849-c81892c2cced None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:27.025539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a7350-f85a-444d-b245-27f153099632 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:27.043634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cd411-c096-45fc-ae50-53a8cdeba7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:27.044622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd411-c096-45fc-ae50-53a8cdeba7e4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.045106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd411-c096-45fc-ae50-53a8cdeba7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.048183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd411-c096-45fc-ae50-53a8cdeba7e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.048183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cd411-c096-45fc-ae50-53a8cdeba7e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:27.048183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cd411-c096-45fc-ae50-53a8cdeba7e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:27.049035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cd411-c096-45fc-ae50-53a8cdeba7e4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:27.065969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 239/468] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:27.067383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d777c7e-485b-4968-abb5-ca143b0c9178 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.067769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d777c7e-485b-4968-abb5-ca143b0c9178 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.068089 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d777c7e-485b-4968-abb5-ca143b0c9178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.071781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a688e09-a0b1-4141-ae59-acbda4748785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:27.072618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a688e09-a0b1-4141-ae59-acbda4748785 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.073114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a688e09-a0b1-4141-ae59-acbda4748785 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.073487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a688e09-a0b1-4141-ae59-acbda4748785 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.074897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a688e09-a0b1-4141-ae59-acbda4748785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:27.075341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a688e09-a0b1-4141-ae59-acbda4748785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:27.078137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a688e09-a0b1-4141-ae59-acbda4748785 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:27.092670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 230/469] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:27.093949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a688e09-a0b1-4141-ae59-acbda4748785 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:27.095342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-9d777c7e-485b-4968-abb5-ca143b0c9178 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:27.096525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9d777c7e-485b-4968-abb5-ca143b0c9178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:27.202524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 240/470] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:27.202524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d777c7e-485b-4968-abb5-ca143b0c9178 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:27.239731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a688e09-a0b1-4141-ae59-acbda4748785 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:27.286276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20bc0f-8d12-4ef3-8841-4b451425db5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:27.286276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20bc0f-8d12-4ef3-8841-4b451425db5f None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.286276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20bc0f-8d12-4ef3-8841-4b451425db5f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.286276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20bc0f-8d12-4ef3-8841-4b451425db5f None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.286676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20bc0f-8d12-4ef3-8841-4b451425db5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:27.286676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20bc0f-8d12-4ef3-8841-4b451425db5f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:27.318361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 231/471] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:12:27 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:27.318361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49a1cb-bf07-4c4b-bc92-29517e4c1713 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.318361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49a1cb-bf07-4c4b-bc92-29517e4c1713 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.318361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49a1cb-bf07-4c4b-bc92-29517e4c1713 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.322276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 232/472] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:27.322276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49a1cb-bf07-4c4b-bc92-29517e4c1713 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:27.338283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d777c7e-485b-4968-abb5-ca143b0c9178 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:27.386281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee88467-de38-41b9-9a6a-64479b63e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:27.386281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee88467-de38-41b9-9a6a-64479b63e409 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.386281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee88467-de38-41b9-9a6a-64479b63e409 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.386281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee88467-de38-41b9-9a6a-64479b63e409 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.386713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee88467-de38-41b9-9a6a-64479b63e409 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:27.390275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee88467-de38-41b9-9a6a-64479b63e409 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:27.433630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 241/473] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:12:27 2022] POST /identity/v3/users => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:27.442286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd4ed-b11a-4155-aafe-bbdf95af770b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.442286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd4ed-b11a-4155-aafe-bbdf95af770b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.442286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd4ed-b11a-4155-aafe-bbdf95af770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.478284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4fedd4ed-b11a-4155-aafe-bbdf95af770b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:27.478284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4fedd4ed-b11a-4155-aafe-bbdf95af770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:27.493603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49a1cb-bf07-4c4b-bc92-29517e4c1713 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:27.588530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88bebc-848d-4e6a-9f2f-5ed61a9be8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:27.589285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88bebc-848d-4e6a-9f2f-5ed61a9be8a8 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.590333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88bebc-848d-4e6a-9f2f-5ed61a9be8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.594308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88bebc-848d-4e6a-9f2f-5ed61a9be8a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.609980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88bebc-848d-4e6a-9f2f-5ed61a9be8a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:27.611494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88bebc-848d-4e6a-9f2f-5ed61a9be8a8 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:27.625603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 242/474] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:27.630276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-3e88bebc-848d-4e6a-9f2f-5ed61a9be8a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:27.631849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 233/475] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:27.638135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd4ed-b11a-4155-aafe-bbdf95af770b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:27.666295 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88bebc-848d-4e6a-9f2f-5ed61a9be8a8 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:27.814926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd4ed-b11a-4155-aafe-bbdf95af770b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:27.834307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88bebc-848d-4e6a-9f2f-5ed61a9be8a8 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:27.867327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d79f08-308e-4713-ba4e-a3d3f8a8c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:27.868309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d79f08-308e-4713-ba4e-a3d3f8a8c170 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.868742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d79f08-308e-4713-ba4e-a3d3f8a8c170 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.869248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d79f08-308e-4713-ba4e-a3d3f8a8c170 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.870119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d79f08-308e-4713-ba4e-a3d3f8a8c170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:27.870657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d79f08-308e-4713-ba4e-a3d3f8a8c170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:27.872759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d79f08-308e-4713-ba4e-a3d3f8a8c170 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:27.872932 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:27.873632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:27.873970 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:27.874304 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:27.875072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:27.876446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:27.886552 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 243/476] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:27.886998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.sql.core [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 12 00:12:27.886998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 12 00:12:27.886998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [parameters: {'id': '155ae32545a348deb2e2132c6f4dc406', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 12 00:12:27.886998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86099) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 00:12:27.899281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d79f08-308e-4713-ba4e-a3d3f8a8c170 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:27.904154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 12 00:12:27.906356 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 234/477] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 00:12:27 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:27.919578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:28.043213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d79f08-308e-4713-ba4e-a3d3f8a8c170 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:28.082322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48697967-5a99-4ca0-ab69-82e931f5a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:28.083063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48697967-5a99-4ca0-ab69-82e931f5a0eb None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:28.083559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48697967-5a99-4ca0-ab69-82e931f5a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:28.083839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48697967-5a99-4ca0-ab69-82e931f5a0eb None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:28.084542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48697967-5a99-4ca0-ab69-82e931f5a0eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:28.086029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48697967-5a99-4ca0-ab69-82e931f5a0eb None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:28.112757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 244/478] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:12:27 2022] POST /identity/v3/users => generated 249 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:28.112941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7b8a9-742b-4fcd-96d2-871aa107f6c6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:28.212225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db62c6d-a009-470a-9586-1085b519c755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:28.213058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62c6d-a009-470a-9586-1085b519c755 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:28.213339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62c6d-a009-470a-9586-1085b519c755 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:28.213611 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db62c6d-a009-470a-9586-1085b519c755 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:28.239367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db62c6d-a009-470a-9586-1085b519c755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:28.247353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-4db62c6d-a009-470a-9586-1085b519c755 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 12 00:12:28.248851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 235/479] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:12:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:28.256528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48697967-5a99-4ca0-ab69-82e931f5a0eb None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:28.421004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48697967-5a99-4ca0-ab69-82e931f5a0eb None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:28.459038 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ee550-603a-46a8-879b-40f3d5b2c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:28.459723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ee550-603a-46a8-879b-40f3d5b2c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:28.460000 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ee550-603a-46a8-879b-40f3d5b2c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:28.460268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ee550-603a-46a8-879b-40f3d5b2c5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:28.461139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ee550-603a-46a8-879b-40f3d5b2c5d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:28.461448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ee550-603a-46a8-879b-40f3d5b2c5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:28.462885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ee550-603a-46a8-879b-40f3d5b2c5d6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:28.472326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 245/480] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:30.071612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9e944-d7a9-4593-855e-c33354d76622 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.072173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9e944-d7a9-4593-855e-c33354d76622 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.072173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9e944-d7a9-4593-855e-c33354d76622 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.073523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 236/481] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:30.079673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44eb4a-a6b4-4d4b-959c-c6c21a6f60d0 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.080129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44eb4a-a6b4-4d4b-959c-c6c21a6f60d0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.080213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44eb4a-a6b4-4d4b-959c-c6c21a6f60d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.103740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-cf44eb4a-a6b4-4d4b-959c-c6c21a6f60d0 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:30.104947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-cf44eb4a-a6b4-4d4b-959c-c6c21a6f60d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:30.200420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 246/482] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:30.240060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9e944-d7a9-4593-855e-c33354d76622 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:30.423981 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9e944-d7a9-4593-855e-c33354d76622 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:30.471240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc911e-6767-4e01-b84d-df1880599a99 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.471579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc911e-6767-4e01-b84d-df1880599a99 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.471777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc911e-6767-4e01-b84d-df1880599a99 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.473388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 247/483] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:30.479359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc40483-6bbb-4ef0-9bb6-d53d102b869c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.479642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc40483-6bbb-4ef0-9bb6-d53d102b869c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.479915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc40483-6bbb-4ef0-9bb6-d53d102b869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.491898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a75690-9fa7-485b-b226-7b4c4d5898b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:30.492721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a75690-9fa7-485b-b226-7b4c4d5898b6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.493009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a75690-9fa7-485b-b226-7b4c4d5898b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.493284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a75690-9fa7-485b-b226-7b4c4d5898b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.501707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2fc40483-6bbb-4ef0-9bb6-d53d102b869c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:30.503857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2fc40483-6bbb-4ef0-9bb6-d53d102b869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:30.516859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a75690-9fa7-485b-b226-7b4c4d5898b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:30.524443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-e8a75690-9fa7-485b-b226-7b4c4d5898b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:30.525351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 237/484] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:30.526866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7da15-0c45-4ad6-aa88-2c0d1f0bc70b None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.527675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7da15-0c45-4ad6-aa88-2c0d1f0bc70b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.527954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7da15-0c45-4ad6-aa88-2c0d1f0bc70b None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.529210 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 238/485] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:30.533942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7da15-0c45-4ad6-aa88-2c0d1f0bc70b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:30.604097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 248/486] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:12:30.606052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633dff2-41b7-4d72-bcb7-8ae7f8b4d20c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.606369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633dff2-41b7-4d72-bcb7-8ae7f8b4d20c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.606645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633dff2-41b7-4d72-bcb7-8ae7f8b4d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.628627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c633dff2-41b7-4d72-bcb7-8ae7f8b4d20c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:30.631143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c633dff2-41b7-4d72-bcb7-8ae7f8b4d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:30.673184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7da15-0c45-4ad6-aa88-2c0d1f0bc70b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:30.727869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01b8bd-2e66-4233-bdf9-4034cfd7656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:30.728946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01b8bd-2e66-4233-bdf9-4034cfd7656c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.729411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 249/487] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:30.730580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01b8bd-2e66-4233-bdf9-4034cfd7656c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.731015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633dff2-41b7-4d72-bcb7-8ae7f8b4d20c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:30.731487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01b8bd-2e66-4233-bdf9-4034cfd7656c None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.732887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01b8bd-2e66-4233-bdf9-4034cfd7656c None admin] RBAC: Adding query filter params (name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:30.733412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01b8bd-2e66-4233-bdf9-4034cfd7656c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:30.735103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01b8bd-2e66-4233-bdf9-4034cfd7656c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:30.754132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 239/488] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:30.767284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01b8bd-2e66-4233-bdf9-4034cfd7656c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:30.895156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633dff2-41b7-4d72-bcb7-8ae7f8b4d20c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:30.904768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01b8bd-2e66-4233-bdf9-4034cfd7656c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:30.946274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e33ccc-95ee-431a-9e27-9bf114b38d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:30.950272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e33ccc-95ee-431a-9e27-9bf114b38d4b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.950272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e33ccc-95ee-431a-9e27-9bf114b38d4b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.950272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e33ccc-95ee-431a-9e27-9bf114b38d4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.960767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c219a-0afa-4d4f-afea-37b2ed4b53f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:30.961564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e33ccc-95ee-431a-9e27-9bf114b38d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:30.961684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c219a-0afa-4d4f-afea-37b2ed4b53f3 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:30.962278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c219a-0afa-4d4f-afea-37b2ed4b53f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:30.962278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c219a-0afa-4d4f-afea-37b2ed4b53f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:30.963232 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e33ccc-95ee-431a-9e27-9bf114b38d4b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:30.977990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9c219a-0afa-4d4f-afea-37b2ed4b53f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:30.982102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-68e33ccc-95ee-431a-9e27-9bf114b38d4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:30.983351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 240/489] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:30.984212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e33ccc-95ee-431a-9e27-9bf114b38d4b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:30.993906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-1e9c219a-0afa-4d4f-afea-37b2ed4b53f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:30.995170 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 250/490] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:30.996507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c219a-0afa-4d4f-afea-37b2ed4b53f3 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:31.102229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e33ccc-95ee-431a-9e27-9bf114b38d4b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:31.150282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c528b2-b6cb-47de-82e8-f8180edf598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:31.150282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c528b2-b6cb-47de-82e8-f8180edf598b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.150282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c528b2-b6cb-47de-82e8-f8180edf598b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.150655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c528b2-b6cb-47de-82e8-f8180edf598b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.172908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c528b2-b6cb-47de-82e8-f8180edf598b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:31.180039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-58c528b2-b6cb-47de-82e8-f8180edf598b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:31.186272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 241/491] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:31.187837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c528b2-b6cb-47de-82e8-f8180edf598b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:31.205188 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c219a-0afa-4d4f-afea-37b2ed4b53f3 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:31.271464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98410d42-3f4b-4422-afb3-0d7cac1568ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:31.272071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98410d42-3f4b-4422-afb3-0d7cac1568ca None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.272352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98410d42-3f4b-4422-afb3-0d7cac1568ca None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.274338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98410d42-3f4b-4422-afb3-0d7cac1568ca None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.274338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98410d42-3f4b-4422-afb3-0d7cac1568ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:31.274338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98410d42-3f4b-4422-afb3-0d7cac1568ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:31.275076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98410d42-3f4b-4422-afb3-0d7cac1568ca None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:31.295927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 251/492] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:31.296766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98410d42-3f4b-4422-afb3-0d7cac1568ca None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:31.384318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c528b2-b6cb-47de-82e8-f8180edf598b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:31.450276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963955df-0961-46f4-8e35-b751fb1ce3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:31.450276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963955df-0961-46f4-8e35-b751fb1ce3a9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.450276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963955df-0961-46f4-8e35-b751fb1ce3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.450276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963955df-0961-46f4-8e35-b751fb1ce3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.450694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963955df-0961-46f4-8e35-b751fb1ce3a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:31.450694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963955df-0961-46f4-8e35-b751fb1ce3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:31.453877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963955df-0961-46f4-8e35-b751fb1ce3a9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:31.470155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98410d42-3f4b-4422-afb3-0d7cac1568ca None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:31.472230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 242/493] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:31.473539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963955df-0961-46f4-8e35-b751fb1ce3a9 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:31.526355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c149e0-00d4-40c9-aff0-07e8c0ad7893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:31.526355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c149e0-00d4-40c9-aff0-07e8c0ad7893 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.526355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c149e0-00d4-40c9-aff0-07e8c0ad7893 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.526355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c149e0-00d4-40c9-aff0-07e8c0ad7893 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.526741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c149e0-00d4-40c9-aff0-07e8c0ad7893 None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:31.526741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c149e0-00d4-40c9-aff0-07e8c0ad7893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:31.530271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c149e0-00d4-40c9-aff0-07e8c0ad7893 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:31.539874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 252/494] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:31.540783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c149e0-00d4-40c9-aff0-07e8c0ad7893 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:31.625394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963955df-0961-46f4-8e35-b751fb1ce3a9 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:31.662163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c149e0-00d4-40c9-aff0-07e8c0ad7893 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:31.670769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1badfd-76e0-44e3-8736-099c369572dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:31.671942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1badfd-76e0-44e3-8736-099c369572dc None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.672230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1badfd-76e0-44e3-8736-099c369572dc None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.672504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1badfd-76e0-44e3-8736-099c369572dc None admin] PATH_INFO: `/v3/users/glance` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.681208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1badfd-76e0-44e3-8736-099c369572dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:31.682708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1badfd-76e0-44e3-8736-099c369572dc None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:31.697898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-0d1badfd-76e0-44e3-8736-099c369572dc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 00:12:31.699693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 243/495] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:31.701531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718b267-64ff-4fcc-aaab-1d6145a43474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:31.702582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718b267-64ff-4fcc-aaab-1d6145a43474 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.703042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718b267-64ff-4fcc-aaab-1d6145a43474 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.703221 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1badfd-76e0-44e3-8736-099c369572dc None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:31.703674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718b267-64ff-4fcc-aaab-1d6145a43474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.716563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718b267-64ff-4fcc-aaab-1d6145a43474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:31.718297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718b267-64ff-4fcc-aaab-1d6145a43474 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:31.734814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-a718b267-64ff-4fcc-aaab-1d6145a43474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:31.738443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 253/496] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:31.738443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07958e74-fb13-49f2-8829-c699ae0596cd None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.738443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07958e74-fb13-49f2-8829-c699ae0596cd None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.738443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07958e74-fb13-49f2-8829-c699ae0596cd None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.742379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 254/497] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:31.744000 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b75f01-ccac-4168-8768-c5e65e1a6354 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.744381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b75f01-ccac-4168-8768-c5e65e1a6354 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.744719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b75f01-ccac-4168-8768-c5e65e1a6354 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.746775 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 255/498] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:31.748496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b75f01-ccac-4168-8768-c5e65e1a6354 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:31.808357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1badfd-76e0-44e3-8736-099c369572dc None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:31.842658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c9e0c-984b-4382-b831-0a0c1773c2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:31.843452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c9e0c-984b-4382-b831-0a0c1773c2aa None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.843730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c9e0c-984b-4382-b831-0a0c1773c2aa None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.844002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c9e0c-984b-4382-b831-0a0c1773c2aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.854644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c9e0c-984b-4382-b831-0a0c1773c2aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:31.856638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c9e0c-984b-4382-b831-0a0c1773c2aa None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:31.858606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b75f01-ccac-4168-8768-c5e65e1a6354 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:31.873694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-409c9e0c-984b-4382-b831-0a0c1773c2aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:31.874953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 244/499] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:31.875721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c9e0c-984b-4382-b831-0a0c1773c2aa None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:31.896977 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea386-c44a-4acd-b33f-9feebc9f4c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:31.898405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea386-c44a-4acd-b33f-9feebc9f4c7b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.899162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea386-c44a-4acd-b33f-9feebc9f4c7b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.899646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea386-c44a-4acd-b33f-9feebc9f4c7b None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.900493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea386-c44a-4acd-b33f-9feebc9f4c7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:31.900969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea386-c44a-4acd-b33f-9feebc9f4c7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:31.903568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea386-c44a-4acd-b33f-9feebc9f4c7b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:31.942966 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 256/500] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 00:12:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:31.944302 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af57cf-fa82-49e2-902e-bcd3990981b7 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.944593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af57cf-fa82-49e2-902e-bcd3990981b7 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.944871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af57cf-fa82-49e2-902e-bcd3990981b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.963592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c4af57cf-fa82-49e2-902e-bcd3990981b7 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:31.965306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c4af57cf-fa82-49e2-902e-bcd3990981b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:31.979909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c9e0c-984b-4382-b831-0a0c1773c2aa None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.015581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883d9ec-4c3d-460e-b1d0-d8e233df698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.016247 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d9ec-4c3d-460e-b1d0-d8e233df698b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.016529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d9ec-4c3d-460e-b1d0-d8e233df698b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.016798 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d9ec-4c3d-460e-b1d0-d8e233df698b None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.017517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d9ec-4c3d-460e-b1d0-d8e233df698b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:32.017819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d9ec-4c3d-460e-b1d0-d8e233df698b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.019220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d9ec-4c3d-460e-b1d0-d8e233df698b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.031335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 245/501] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:32.032751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2717c-80d2-4052-b59d-a6abe049a415 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.033042 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2717c-80d2-4052-b59d-a6abe049a415 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.033316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2717c-80d2-4052-b59d-a6abe049a415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.039251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 257/502] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:32.040090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af57cf-fa82-49e2-902e-bcd3990981b7 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.051249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-13f2717c-80d2-4052-b59d-a6abe049a415 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:32.053184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-13f2717c-80d2-4052-b59d-a6abe049a415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:32.123681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 246/503] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:32.124416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2717c-80d2-4052-b59d-a6abe049a415 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.140392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af57cf-fa82-49e2-902e-bcd3990981b7 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.175719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f43da9-fa8b-418a-971c-74db20a111e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.176381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f43da9-fa8b-418a-971c-74db20a111e7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.176804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f43da9-fa8b-418a-971c-74db20a111e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.176920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f43da9-fa8b-418a-971c-74db20a111e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.177646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f43da9-fa8b-418a-971c-74db20a111e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:32.177954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f43da9-fa8b-418a-971c-74db20a111e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.179348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f43da9-fa8b-418a-971c-74db20a111e7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.190845 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 258/504] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:32.191897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f43da9-fa8b-418a-971c-74db20a111e7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.238898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2717c-80d2-4052-b59d-a6abe049a415 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.275671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31dde5-34c1-4b3e-9b65-82ee7d6b357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.276328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31dde5-34c1-4b3e-9b65-82ee7d6b357a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.276612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31dde5-34c1-4b3e-9b65-82ee7d6b357a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.276885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31dde5-34c1-4b3e-9b65-82ee7d6b357a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.291450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f43da9-fa8b-418a-971c-74db20a111e7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.326922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdcfb7-b211-4986-b7ee-8604fc921187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.327724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdcfb7-b211-4986-b7ee-8604fc921187 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.328170 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdcfb7-b211-4986-b7ee-8604fc921187 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.328285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdcfb7-b211-4986-b7ee-8604fc921187 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.336245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdcfb7-b211-4986-b7ee-8604fc921187 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.337683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bdcfb7-b211-4986-b7ee-8604fc921187 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.350445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31dde5-34c1-4b3e-9b65-82ee7d6b357a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.351073 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-66bdcfb7-b211-4986-b7ee-8604fc921187 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 00:12:32.351951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31dde5-34c1-4b3e-9b65-82ee7d6b357a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.352447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 259/505] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:32.353038 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdcfb7-b211-4986-b7ee-8604fc921187 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.455713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdcfb7-b211-4986-b7ee-8604fc921187 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.459017 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 247/506] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:32.463299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31dde5-34c1-4b3e-9b65-82ee7d6b357a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.492706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2797-856f-4ef5-9677-87c5e734cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.493613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2797-856f-4ef5-9677-87c5e734cb8d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.493968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2797-856f-4ef5-9677-87c5e734cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.494358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2797-856f-4ef5-9677-87c5e734cb8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.505020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2797-856f-4ef5-9677-87c5e734cb8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:32.512611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-550b2797-856f-4ef5-9677-87c5e734cb8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:32.514243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 260/507] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:32.515103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2797-856f-4ef5-9677-87c5e734cb8d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.569667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31dde5-34c1-4b3e-9b65-82ee7d6b357a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.604513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711fb43-fbb4-4bb0-b9a2-4e065b2c138b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.605416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711fb43-fbb4-4bb0-b9a2-4e065b2c138b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.605705 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711fb43-fbb4-4bb0-b9a2-4e065b2c138b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.605985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711fb43-fbb4-4bb0-b9a2-4e065b2c138b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.615588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2797-856f-4ef5-9677-87c5e734cb8d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.617190 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711fb43-fbb4-4bb0-b9a2-4e065b2c138b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.618585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711fb43-fbb4-4bb0-b9a2-4e065b2c138b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.635945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-d711fb43-fbb4-4bb0-b9a2-4e065b2c138b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:32.638333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 248/508] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:32.638333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711fb43-fbb4-4bb0-b9a2-4e065b2c138b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.648174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6b5b-9211-4b08-a460-36a49c758674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.649054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6b5b-9211-4b08-a460-36a49c758674 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.649409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6b5b-9211-4b08-a460-36a49c758674 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.649691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f6b5b-9211-4b08-a460-36a49c758674 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.659121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f6b5b-9211-4b08-a460-36a49c758674 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.660565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f6b5b-9211-4b08-a460-36a49c758674 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.675922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-a80f6b5b-9211-4b08-a460-36a49c758674 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 00:12:32.677276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 261/509] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:32.677943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6b5b-9211-4b08-a460-36a49c758674 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.742361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711fb43-fbb4-4bb0-b9a2-4e065b2c138b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.782037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f6b5b-9211-4b08-a460-36a49c758674 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.783650 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b44ccf-716a-4200-a477-be5ade2a0f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.784319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b44ccf-716a-4200-a477-be5ade2a0f89 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.784596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b44ccf-716a-4200-a477-be5ade2a0f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.784867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b44ccf-716a-4200-a477-be5ade2a0f89 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.785688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b44ccf-716a-4200-a477-be5ade2a0f89 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:32.785992 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b44ccf-716a-4200-a477-be5ade2a0f89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.787448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b44ccf-716a-4200-a477-be5ade2a0f89 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.816868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e097372-3de7-45c8-885f-2651d82d7a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.817720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e097372-3de7-45c8-885f-2651d82d7a61 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.818025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e097372-3de7-45c8-885f-2651d82d7a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.818331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e097372-3de7-45c8-885f-2651d82d7a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.823510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 249/510] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:32.824943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b44ccf-716a-4200-a477-be5ade2a0f89 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.829825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e097372-3de7-45c8-885f-2651d82d7a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.831538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e097372-3de7-45c8-885f-2651d82d7a61 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.847525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-5e097372-3de7-45c8-885f-2651d82d7a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:32.848700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 262/511] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:32.849452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e097372-3de7-45c8-885f-2651d82d7a61 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.929014 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b44ccf-716a-4200-a477-be5ade2a0f89 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.956985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e097372-3de7-45c8-885f-2651d82d7a61 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.962201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331c706-91d9-491d-902d-5f65881921ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.962888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c706-91d9-491d-902d-5f65881921ff None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.963166 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c706-91d9-491d-902d-5f65881921ff None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.963441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331c706-91d9-491d-902d-5f65881921ff None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.964169 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331c706-91d9-491d-902d-5f65881921ff None admin] RBAC: Adding query filter params (name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:32.964470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331c706-91d9-491d-902d-5f65881921ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.965853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331c706-91d9-491d-902d-5f65881921ff None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.973368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 250/512] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:32.974547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331c706-91d9-491d-902d-5f65881921ff None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.994300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b500af-d21b-4a1c-9350-ef99ea45654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.994914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b500af-d21b-4a1c-9350-ef99ea45654e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.995203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b500af-d21b-4a1c-9350-ef99ea45654e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.995478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b500af-d21b-4a1c-9350-ef99ea45654e None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.996753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b500af-d21b-4a1c-9350-ef99ea45654e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:32.997068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b500af-d21b-4a1c-9350-ef99ea45654e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.998433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b500af-d21b-4a1c-9350-ef99ea45654e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:33.010739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 263/513] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:33.011157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b500af-d21b-4a1c-9350-ef99ea45654e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:33.078165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331c706-91d9-491d-902d-5f65881921ff None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:33.110623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c2ac7-3ff2-480e-af42-d473ffdf2fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:33.111305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2ac7-3ff2-480e-af42-d473ffdf2fd7 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:33.111586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2ac7-3ff2-480e-af42-d473ffdf2fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:33.111858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c2ac7-3ff2-480e-af42-d473ffdf2fd7 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:33.112700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c2ac7-3ff2-480e-af42-d473ffdf2fd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:33.113003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c2ac7-3ff2-480e-af42-d473ffdf2fd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:33.114453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c2ac7-3ff2-480e-af42-d473ffdf2fd7 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:33.118113 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b500af-d21b-4a1c-9350-ef99ea45654e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:33.131196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 251/514] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:33.131991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c2ac7-3ff2-480e-af42-d473ffdf2fd7 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:33.156009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc56957-a034-4037-96ac-866bed6a3d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:33.156664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc56957-a034-4037-96ac-866bed6a3d2e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:33.156940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc56957-a034-4037-96ac-866bed6a3d2e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:33.157323 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc56957-a034-4037-96ac-866bed6a3d2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:33.228464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c2ac7-3ff2-480e-af42-d473ffdf2fd7 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:33.237982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc56957-a034-4037-96ac-866bed6a3d2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:33.239762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc56957-a034-4037-96ac-866bed6a3d2e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:33.261924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb53afa-270c-4490-8b23-dbf4f43c9246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:33.262522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb53afa-270c-4490-8b23-dbf4f43c9246 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:33.262800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb53afa-270c-4490-8b23-dbf4f43c9246 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:33.263069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb53afa-270c-4490-8b23-dbf4f43c9246 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:33.263769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb53afa-270c-4490-8b23-dbf4f43c9246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:33.264067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb53afa-270c-4490-8b23-dbf4f43c9246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:33.265408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb53afa-270c-4490-8b23-dbf4f43c9246 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:33.276007 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 252/515] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:33.277518 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb53afa-270c-4490-8b23-dbf4f43c9246 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:33.342816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 264/516] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:33.343480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc56957-a034-4037-96ac-866bed6a3d2e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:33.387952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb53afa-270c-4490-8b23-dbf4f43c9246 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:33.423341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3be7c-ea9d-4b8f-8e3c-5bf42bb67b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:33.424124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3be7c-ea9d-4b8f-8e3c-5bf42bb67b8a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:33.424405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3be7c-ea9d-4b8f-8e3c-5bf42bb67b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:33.424676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3be7c-ea9d-4b8f-8e3c-5bf42bb67b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:33.435038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3be7c-ea9d-4b8f-8e3c-5bf42bb67b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:33.436481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3be7c-ea9d-4b8f-8e3c-5bf42bb67b8a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:33.447709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc56957-a034-4037-96ac-866bed6a3d2e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:33.452093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-14f3be7c-ea9d-4b8f-8e3c-5bf42bb67b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:33.458053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 253/517] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:33.458053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3be7c-ea9d-4b8f-8e3c-5bf42bb67b8a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:33.484549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd474bc-0252-4758-90be-2c65ad978b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:33.485210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd474bc-0252-4758-90be-2c65ad978b9a None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:33.485488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd474bc-0252-4758-90be-2c65ad978b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:33.485760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd474bc-0252-4758-90be-2c65ad978b9a None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:33.486476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd474bc-0252-4758-90be-2c65ad978b9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:33.487885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd474bc-0252-4758-90be-2c65ad978b9a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:33.508709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 265/518] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:12:33 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:33.509581 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd474bc-0252-4758-90be-2c65ad978b9a None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:33.585133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3be7c-ea9d-4b8f-8e3c-5bf42bb67b8a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:33.632771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd474bc-0252-4758-90be-2c65ad978b9a None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:33.647022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6657b2-a6b8-497f-ad67-410c6ce8835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:33.647703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6657b2-a6b8-497f-ad67-410c6ce8835c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:33.647991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6657b2-a6b8-497f-ad67-410c6ce8835c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:33.648268 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6657b2-a6b8-497f-ad67-410c6ce8835c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:33.682988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1f71a-6087-48b1-a6d8-876f350ad20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:33.683836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f71a-6087-48b1-a6d8-876f350ad20d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:33.684122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f71a-6087-48b1-a6d8-876f350ad20d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:33.684400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1f71a-6087-48b1-a6d8-876f350ad20d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:33.697237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1f71a-6087-48b1-a6d8-876f350ad20d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:33.700890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1f71a-6087-48b1-a6d8-876f350ad20d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:33.716567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-33d1f71a-6087-48b1-a6d8-876f350ad20d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:33.717787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 266/519] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:33.719183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1f71a-6087-48b1-a6d8-876f350ad20d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:33.748207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6657b2-a6b8-497f-ad67-410c6ce8835c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:33.750877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6657b2-a6b8-497f-ad67-410c6ce8835c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:33.835114 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1f71a-6087-48b1-a6d8-876f350ad20d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:33.888866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed5363-b563-44e3-99fb-10e133713b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:33.891884 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5363-b563-44e3-99fb-10e133713b33 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:33.892181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5363-b563-44e3-99fb-10e133713b33 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:33.893053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5363-b563-44e3-99fb-10e133713b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:33.900569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 254/520] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:33.901630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6657b2-a6b8-497f-ad67-410c6ce8835c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:33.916564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed5363-b563-44e3-99fb-10e133713b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:33.918971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed5363-b563-44e3-99fb-10e133713b33 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:33.938581 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-8bed5363-b563-44e3-99fb-10e133713b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:33.942438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 267/521] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:33.943195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed5363-b563-44e3-99fb-10e133713b33 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.046836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6657b2-a6b8-497f-ad67-410c6ce8835c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.085401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e297e-ba0c-4de4-b217-a8eadeb4a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.086388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e297e-ba0c-4de4-b217-a8eadeb4a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.086866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e297e-ba0c-4de4-b217-a8eadeb4a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.087330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e297e-ba0c-4de4-b217-a8eadeb4a0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.088225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e297e-ba0c-4de4-b217-a8eadeb4a0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:34.088706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e297e-ba0c-4de4-b217-a8eadeb4a0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.090343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e297e-ba0c-4de4-b217-a8eadeb4a0b2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.106290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 255/522] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:34.107317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e297e-ba0c-4de4-b217-a8eadeb4a0b2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.141113 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed5363-b563-44e3-99fb-10e133713b33 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.173851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a328fc1-632a-435c-b811-f5764747909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.174799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328fc1-632a-435c-b811-f5764747909b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.175295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328fc1-632a-435c-b811-f5764747909b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.175782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a328fc1-632a-435c-b811-f5764747909b None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.176744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a328fc1-632a-435c-b811-f5764747909b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:34.177245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a328fc1-632a-435c-b811-f5764747909b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.178896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a328fc1-632a-435c-b811-f5764747909b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.196858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 268/523] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:34.197901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a328fc1-632a-435c-b811-f5764747909b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.210279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e297e-ba0c-4de4-b217-a8eadeb4a0b2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.244437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc24372-bd1e-402b-acb1-34e5f19df771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.245485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc24372-bd1e-402b-acb1-34e5f19df771 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.246573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc24372-bd1e-402b-acb1-34e5f19df771 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.247009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc24372-bd1e-402b-acb1-34e5f19df771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.257720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc24372-bd1e-402b-acb1-34e5f19df771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.259426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc24372-bd1e-402b-acb1-34e5f19df771 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.276273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-8cc24372-bd1e-402b-acb1-34e5f19df771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:34.278080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 256/524] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:34.279115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc24372-bd1e-402b-acb1-34e5f19df771 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.304483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a328fc1-632a-435c-b811-f5764747909b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.339210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2bd0c-025d-43f3-bf64-8ec45d23ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.340026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2bd0c-025d-43f3-bf64-8ec45d23ae57 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.340376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2bd0c-025d-43f3-bf64-8ec45d23ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.340721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2bd0c-025d-43f3-bf64-8ec45d23ae57 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.341443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2bd0c-025d-43f3-bf64-8ec45d23ae57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:34.341749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2bd0c-025d-43f3-bf64-8ec45d23ae57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.343157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2bd0c-025d-43f3-bf64-8ec45d23ae57 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.355051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 269/525] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:34.356379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2bd0c-025d-43f3-bf64-8ec45d23ae57 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.385458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc24372-bd1e-402b-acb1-34e5f19df771 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.418215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8a5c3-ac19-442b-92ef-5ddd6b3c346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.418997 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8a5c3-ac19-442b-92ef-5ddd6b3c346e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.419282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8a5c3-ac19-442b-92ef-5ddd6b3c346e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.419556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8a5c3-ac19-442b-92ef-5ddd6b3c346e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.426925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8a5c3-ac19-442b-92ef-5ddd6b3c346e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.428357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8a5c3-ac19-442b-92ef-5ddd6b3c346e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.442171 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-e6a8a5c3-ac19-442b-92ef-5ddd6b3c346e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 00:12:34.443550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 257/526] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:34.445233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8a5c3-ac19-442b-92ef-5ddd6b3c346e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.461895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2bd0c-025d-43f3-bf64-8ec45d23ae57 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.494778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45b57f-414b-4b57-b8a2-a50b08d5f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.495652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b57f-414b-4b57-b8a2-a50b08d5f31d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.495990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b57f-414b-4b57-b8a2-a50b08d5f31d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.496272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45b57f-414b-4b57-b8a2-a50b08d5f31d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.497090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45b57f-414b-4b57-b8a2-a50b08d5f31d None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=dfaf01f45e7a429e9361eb176a3f7c38) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:34.497406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45b57f-414b-4b57-b8a2-a50b08d5f31d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.498860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45b57f-414b-4b57-b8a2-a50b08d5f31d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.506224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 270/527] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/role_assignments?user.id=dfaf01f45e7a429e9361eb176a3f7c38&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:34.507044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45b57f-414b-4b57-b8a2-a50b08d5f31d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.567372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8a5c3-ac19-442b-92ef-5ddd6b3c346e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.612753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ab079-0f87-42bc-8752-598bc3e3ac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.614288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ab079-0f87-42bc-8752-598bc3e3ac45 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.614672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ab079-0f87-42bc-8752-598bc3e3ac45 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.614952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ab079-0f87-42bc-8752-598bc3e3ac45 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.615709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ab079-0f87-42bc-8752-598bc3e3ac45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:34.616016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ab079-0f87-42bc-8752-598bc3e3ac45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.618042 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ab079-0f87-42bc-8752-598bc3e3ac45 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.620638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45b57f-414b-4b57-b8a2-a50b08d5f31d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.638290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 258/528] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:34.638290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ab079-0f87-42bc-8752-598bc3e3ac45 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.679665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6326c5-2bb9-495e-ab95-a833bbd2efce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.680885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6326c5-2bb9-495e-ab95-a833bbd2efce None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.681322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6326c5-2bb9-495e-ab95-a833bbd2efce None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.681745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6326c5-2bb9-495e-ab95-a833bbd2efce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.691930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6326c5-2bb9-495e-ab95-a833bbd2efce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.694458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6326c5-2bb9-495e-ab95-a833bbd2efce None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.713624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-fa6326c5-2bb9-495e-ab95-a833bbd2efce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:34.715332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 271/529] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:34.716178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6326c5-2bb9-495e-ab95-a833bbd2efce None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.761127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ab079-0f87-42bc-8752-598bc3e3ac45 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.806331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1e3b7-b218-4af5-937f-a4eeb36bb18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.807456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e3b7-b218-4af5-937f-a4eeb36bb18b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.808356 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e3b7-b218-4af5-937f-a4eeb36bb18b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.808832 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1e3b7-b218-4af5-937f-a4eeb36bb18b None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.810106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1e3b7-b218-4af5-937f-a4eeb36bb18b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:34.810766 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1e3b7-b218-4af5-937f-a4eeb36bb18b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.812688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1e3b7-b218-4af5-937f-a4eeb36bb18b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.825623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6326c5-2bb9-495e-ab95-a833bbd2efce None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.840490 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 259/530] 10.222.0.32 () {56 vars in 1139 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:34.840490 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1e3b7-b218-4af5-937f-a4eeb36bb18b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.870582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b479af-6538-4b21-9458-d5e1e654fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.872184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b479af-6538-4b21-9458-d5e1e654fc1c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.872611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b479af-6538-4b21-9458-d5e1e654fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.873047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b479af-6538-4b21-9458-d5e1e654fc1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.884814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b479af-6538-4b21-9458-d5e1e654fc1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.887281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b479af-6538-4b21-9458-d5e1e654fc1c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:34.905049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-d2b479af-6538-4b21-9458-d5e1e654fc1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:34.907066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 272/531] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:34.907997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b479af-6538-4b21-9458-d5e1e654fc1c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:34.946181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1e3b7-b218-4af5-937f-a4eeb36bb18b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:34.988675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc4c36-53aa-440b-afbf-450b220d8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:34.989566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc4c36-53aa-440b-afbf-450b220d8699 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:34.990313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc4c36-53aa-440b-afbf-450b220d8699 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:34.990988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc4c36-53aa-440b-afbf-450b220d8699 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:34.991939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc4c36-53aa-440b-afbf-450b220d8699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:34.992545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc4c36-53aa-440b-afbf-450b220d8699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:34.994789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc4c36-53aa-440b-afbf-450b220d8699 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:35.011078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b479af-6538-4b21-9458-d5e1e654fc1c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:35.017159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 260/532] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:35.018264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc4c36-53aa-440b-afbf-450b220d8699 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:35.051432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38103d-e626-4cf5-ba4b-ad52532a0a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:35.052209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38103d-e626-4cf5-ba4b-ad52532a0a99 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:35.052788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38103d-e626-4cf5-ba4b-ad52532a0a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:35.052905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38103d-e626-4cf5-ba4b-ad52532a0a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:35.121226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38103d-e626-4cf5-ba4b-ad52532a0a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:35.123009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38103d-e626-4cf5-ba4b-ad52532a0a99 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:35.132201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc4c36-53aa-440b-afbf-450b220d8699 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:35.167202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24827b-d29e-42dc-9a10-67a4b6d2dc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:35.168092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24827b-d29e-42dc-9a10-67a4b6d2dc9a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:35.168474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24827b-d29e-42dc-9a10-67a4b6d2dc9a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:35.168849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24827b-d29e-42dc-9a10-67a4b6d2dc9a None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:35.169731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24827b-d29e-42dc-9a10-67a4b6d2dc9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:35.170137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24827b-d29e-42dc-9a10-67a4b6d2dc9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:35.171706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24827b-d29e-42dc-9a10-67a4b6d2dc9a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:35.188200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 261/533] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:35.189191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24827b-d29e-42dc-9a10-67a4b6d2dc9a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:35.235984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 273/534] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:35.237312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38103d-e626-4cf5-ba4b-ad52532a0a99 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:35.286638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24827b-d29e-42dc-9a10-67a4b6d2dc9a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:35.325549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c6431-16e8-4043-921b-063b4a1e1aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:35.326221 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6431-16e8-4043-921b-063b4a1e1aaf None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:35.328389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6431-16e8-4043-921b-063b4a1e1aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:35.330282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c6431-16e8-4043-921b-063b4a1e1aaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:35.330282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c6431-16e8-4043-921b-063b4a1e1aaf None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=73a39479834440ffa85fbc0d58a257d7) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:35.330282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c6431-16e8-4043-921b-063b4a1e1aaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:35.331562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c6431-16e8-4043-921b-063b4a1e1aaf None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:35.337827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 262/535] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:35 2022] GET /identity/v3/role_assignments?user.id=73a39479834440ffa85fbc0d58a257d7&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:35.342423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c6431-16e8-4043-921b-063b4a1e1aaf None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:35.362763 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38103d-e626-4cf5-ba4b-ad52532a0a99 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:35.418992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25344a-e7f7-43f9-a3d9-a87d9c90b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:35.419668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25344a-e7f7-43f9-a3d9-a87d9c90b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:35.419954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25344a-e7f7-43f9-a3d9-a87d9c90b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:35.420230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25344a-e7f7-43f9-a3d9-a87d9c90b4f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:35.421071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25344a-e7f7-43f9-a3d9-a87d9c90b4f5 None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=ecf0479293de4edfbf2815c1e9f2f7cc) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:35.421384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25344a-e7f7-43f9-a3d9-a87d9c90b4f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:35.422890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25344a-e7f7-43f9-a3d9-a87d9c90b4f5 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:35.438029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 274/536] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:35 2022] GET /identity/v3/role_assignments?user.id=ecf0479293de4edfbf2815c1e9f2f7cc&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:35.462123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c6431-16e8-4043-921b-063b4a1e1aaf None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:35.505202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf55c7-01f4-4407-a4e0-bf746e6ab319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:35.505949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf55c7-01f4-4407-a4e0-bf746e6ab319 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:35.506235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf55c7-01f4-4407-a4e0-bf746e6ab319 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:35.506543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf55c7-01f4-4407-a4e0-bf746e6ab319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:35.531662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf55c7-01f4-4407-a4e0-bf746e6ab319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:35.533105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf55c7-01f4-4407-a4e0-bf746e6ab319 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:35.564016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-1baf55c7-01f4-4407-a4e0-bf746e6ab319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:35.570823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 263/537] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:35.579796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25344a-e7f7-43f9-a3d9-a87d9c90b4f5 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:35.729598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25344a-e7f7-43f9-a3d9-a87d9c90b4f5 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:35.773592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf23d4-5ce9-4cab-a9db-00b1ee082c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:35.774198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf23d4-5ce9-4cab-a9db-00b1ee082c2e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:35.774510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf23d4-5ce9-4cab-a9db-00b1ee082c2e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:35.778298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf23d4-5ce9-4cab-a9db-00b1ee082c2e None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:35.778298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf23d4-5ce9-4cab-a9db-00b1ee082c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:35.778298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf23d4-5ce9-4cab-a9db-00b1ee082c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:35.778298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf23d4-5ce9-4cab-a9db-00b1ee082c2e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:35.791136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 275/538] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:35.797855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf55c7-01f4-4407-a4e0-bf746e6ab319 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:35.973940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf55c7-01f4-4407-a4e0-bf746e6ab319 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:36.039845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee866b3d-d49b-4bc6-b78a-731fae5f8335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:36.040668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866b3d-d49b-4bc6-b78a-731fae5f8335 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:36.040965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866b3d-d49b-4bc6-b78a-731fae5f8335 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:36.041242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee866b3d-d49b-4bc6-b78a-731fae5f8335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:36.053228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee866b3d-d49b-4bc6-b78a-731fae5f8335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:36.053228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee866b3d-d49b-4bc6-b78a-731fae5f8335 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:36.074576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-ee866b3d-d49b-4bc6-b78a-731fae5f8335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:36.076097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 264/539] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:36.094186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf23d4-5ce9-4cab-a9db-00b1ee082c2e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:36.209705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf23d4-5ce9-4cab-a9db-00b1ee082c2e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:36.228015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc05d1-ec77-4f8c-8b2e-f0e6f1690ed7 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:36.228613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc05d1-ec77-4f8c-8b2e-f0e6f1690ed7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:36.229106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc05d1-ec77-4f8c-8b2e-f0e6f1690ed7 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:36.234440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 265/540] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:36.235804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a79f-13d9-48d1-84c9-6440c56d7bb4 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:36.236288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a79f-13d9-48d1-84c9-6440c56d7bb4 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:36.236824 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2a79f-13d9-48d1-84c9-6440c56d7bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:36.247072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c2e17-bf54-4c28-8e3e-49d37e13b342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:36.247737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c2e17-bf54-4c28-8e3e-49d37e13b342 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:36.248019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c2e17-bf54-4c28-8e3e-49d37e13b342 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:36.248291 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c2e17-bf54-4c28-8e3e-49d37e13b342 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:36.249076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c2e17-bf54-4c28-8e3e-49d37e13b342 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:36.249387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c2e17-bf54-4c28-8e3e-49d37e13b342 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:36.250853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c2e17-bf54-4c28-8e3e-49d37e13b342 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:36.270077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 276/541] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:36.275352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-7ce2a79f-13d9-48d1-84c9-6440c56d7bb4 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:36.275932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c2e17-bf54-4c28-8e3e-49d37e13b342 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:36.276646 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7ce2a79f-13d9-48d1-84c9-6440c56d7bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:36.351606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 266/542] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:36.389621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a79f-13d9-48d1-84c9-6440c56d7bb4 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:36.447550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c2e17-bf54-4c28-8e3e-49d37e13b342 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:36.508762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4e3ed-3ab4-408a-8631-edf8d9dd94ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:36.509420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4e3ed-3ab4-408a-8631-edf8d9dd94ff None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:36.509698 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4e3ed-3ab4-408a-8631-edf8d9dd94ff None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:36.509970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4e3ed-3ab4-408a-8631-edf8d9dd94ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:36.510827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4e3ed-3ab4-408a-8631-edf8d9dd94ff None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=a99a9951d83446efbf819b72836afc2b) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:36.511130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4e3ed-3ab4-408a-8631-edf8d9dd94ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:36.512052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2a79f-13d9-48d1-84c9-6440c56d7bb4 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:36.512672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4e3ed-3ab4-408a-8631-edf8d9dd94ff None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:36.528963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 277/543] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:36 2022] GET /identity/v3/role_assignments?user.id=a99a9951d83446efbf819b72836afc2b&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:36.548548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45506-9dc9-4749-9811-d2bb08a7d564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:36.549368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45506-9dc9-4749-9811-d2bb08a7d564 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:36.549649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45506-9dc9-4749-9811-d2bb08a7d564 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:36.549922 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45506-9dc9-4749-9811-d2bb08a7d564 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:36.562821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f45506-9dc9-4749-9811-d2bb08a7d564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:36.570193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-73f45506-9dc9-4749-9811-d2bb08a7d564 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:36.571770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 267/544] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:36.578233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4e3ed-3ab4-408a-8631-edf8d9dd94ff None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:36.745313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4e3ed-3ab4-408a-8631-edf8d9dd94ff None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:36.791966 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1f605-6817-4cba-b4f1-e5ab61da99c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:36.793231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1f605-6817-4cba-b4f1-e5ab61da99c0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:36.793539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1f605-6817-4cba-b4f1-e5ab61da99c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:36.793814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1f605-6817-4cba-b4f1-e5ab61da99c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:36.794591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1f605-6817-4cba-b4f1-e5ab61da99c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:36.794895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1f605-6817-4cba-b4f1-e5ab61da99c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:36.796277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1f605-6817-4cba-b4f1-e5ab61da99c0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:36.810430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 278/545] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:36.816060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45506-9dc9-4749-9811-d2bb08a7d564 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:36.950049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45506-9dc9-4749-9811-d2bb08a7d564 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:36.994972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d431c-643d-4b4e-9d1a-3ebeb45e43f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:36.996341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d431c-643d-4b4e-9d1a-3ebeb45e43f5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:36.996624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d431c-643d-4b4e-9d1a-3ebeb45e43f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:36.996892 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d431c-643d-4b4e-9d1a-3ebeb45e43f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:37.007780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d431c-643d-4b4e-9d1a-3ebeb45e43f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:37.009220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d431c-643d-4b4e-9d1a-3ebeb45e43f5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:37.025195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-4a5d431c-643d-4b4e-9d1a-3ebeb45e43f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:37.026713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 268/546] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:37.032539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1f605-6817-4cba-b4f1-e5ab61da99c0 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:37.104684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac670582-41af-4e0a-aa58-0eb34eb1143a None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:37.105034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac670582-41af-4e0a-aa58-0eb34eb1143a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:37.105276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac670582-41af-4e0a-aa58-0eb34eb1143a None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:37.106995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 269/547] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:37.112351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074de1a-8c81-4214-9e65-0bf7bbf6b96a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:37.112637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074de1a-8c81-4214-9e65-0bf7bbf6b96a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:37.113067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074de1a-8c81-4214-9e65-0bf7bbf6b96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:37.139222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c074de1a-8c81-4214-9e65-0bf7bbf6b96a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:37.140403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c074de1a-8c81-4214-9e65-0bf7bbf6b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:37.222762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1f605-6817-4cba-b4f1-e5ab61da99c0 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:37.267986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 270/548] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 12 00:12:37.272832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7752b4-fa27-4c20-841b-ef8824f7d4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:37.273739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7752b4-fa27-4c20-841b-ef8824f7d4a5 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:37.274241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7752b4-fa27-4c20-841b-ef8824f7d4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:37.274739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7752b4-fa27-4c20-841b-ef8824f7d4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:37.275667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7752b4-fa27-4c20-841b-ef8824f7d4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:37.276170 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7752b4-fa27-4c20-841b-ef8824f7d4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:37.277866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7752b4-fa27-4c20-841b-ef8824f7d4a5 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:37.290137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 279/549] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:37.295678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074de1a-8c81-4214-9e65-0bf7bbf6b96a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:37.302605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7752b4-fa27-4c20-841b-ef8824f7d4a5 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:37.462299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7752b4-fa27-4c20-841b-ef8824f7d4a5 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:37.487963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074de1a-8c81-4214-9e65-0bf7bbf6b96a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:37.507223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bfa41-8af0-44a1-aeab-a645b3b53e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:37.508343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bfa41-8af0-44a1-aeab-a645b3b53e76 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:37.508848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bfa41-8af0-44a1-aeab-a645b3b53e76 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:37.509320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bfa41-8af0-44a1-aeab-a645b3b53e76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:37.531580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bfa41-8af0-44a1-aeab-a645b3b53e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:37.539736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-e21bfa41-8af0-44a1-aeab-a645b3b53e76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:37.547764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 280/550] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:37.553502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bfa41-8af0-44a1-aeab-a645b3b53e76 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:37.554569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0971fe-7b64-4243-bae8-9d0ec82ee3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:37.555608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0971fe-7b64-4243-bae8-9d0ec82ee3a8 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:37.556086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0971fe-7b64-4243-bae8-9d0ec82ee3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:37.556565 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0971fe-7b64-4243-bae8-9d0ec82ee3a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:37.564873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0971fe-7b64-4243-bae8-9d0ec82ee3a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:37.566735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0971fe-7b64-4243-bae8-9d0ec82ee3a8 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:37.584273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-da0971fe-7b64-4243-bae8-9d0ec82ee3a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 00:12:37.586537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 271/551] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:37.592949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0971fe-7b64-4243-bae8-9d0ec82ee3a8 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:37.721880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0971fe-7b64-4243-bae8-9d0ec82ee3a8 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:37.760942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dab75a-c612-45fb-89d6-5843b7f5e9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:37.762083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dab75a-c612-45fb-89d6-5843b7f5e9eb None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:37.762613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dab75a-c612-45fb-89d6-5843b7f5e9eb None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:37.763107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dab75a-c612-45fb-89d6-5843b7f5e9eb None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:37.764253 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dab75a-c612-45fb-89d6-5843b7f5e9eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:37.764826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dab75a-c612-45fb-89d6-5843b7f5e9eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:37.766555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dab75a-c612-45fb-89d6-5843b7f5e9eb None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:37.788776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 272/552] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 00:12:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:37.795342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dab75a-c612-45fb-89d6-5843b7f5e9eb None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:37.848408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bfa41-8af0-44a1-aeab-a645b3b53e76 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:37.904244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dab75a-c612-45fb-89d6-5843b7f5e9eb None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:37.938396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcece4-5b85-47e8-9d09-0edcd51a1a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:37.939081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcece4-5b85-47e8-9d09-0edcd51a1a6d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:37.939362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcece4-5b85-47e8-9d09-0edcd51a1a6d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:37.939631 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcece4-5b85-47e8-9d09-0edcd51a1a6d None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:37.940492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcece4-5b85-47e8-9d09-0edcd51a1a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:37.940882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcece4-5b85-47e8-9d09-0edcd51a1a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:37.942422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcece4-5b85-47e8-9d09-0edcd51a1a6d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:37.943780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593cc30-1b8f-4a2d-85e2-072d201047fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:37.944864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593cc30-1b8f-4a2d-85e2-072d201047fa None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:37.945358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593cc30-1b8f-4a2d-85e2-072d201047fa None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:37.945827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593cc30-1b8f-4a2d-85e2-072d201047fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:37.961531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 281/553] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:37.968356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcece4-5b85-47e8-9d09-0edcd51a1a6d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.026656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593cc30-1b8f-4a2d-85e2-072d201047fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:38.028996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593cc30-1b8f-4a2d-85e2-072d201047fa None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:38.093018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcece4-5b85-47e8-9d09-0edcd51a1a6d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:38.143050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469542-4327-4eff-aba1-05f3928341b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:38.143908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469542-4327-4eff-aba1-05f3928341b4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.144193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469542-4327-4eff-aba1-05f3928341b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.144466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469542-4327-4eff-aba1-05f3928341b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.151666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 273/554] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:38.157355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593cc30-1b8f-4a2d-85e2-072d201047fa None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.159662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469542-4327-4eff-aba1-05f3928341b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:38.161288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469542-4327-4eff-aba1-05f3928341b4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:38.187422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-15469542-4327-4eff-aba1-05f3928341b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:38.188918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 282/555] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:38.194352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469542-4327-4eff-aba1-05f3928341b4 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.256449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593cc30-1b8f-4a2d-85e2-072d201047fa None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:38.292533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cac14f-4bea-416c-912e-08c2a0ccb2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:38.294081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac14f-4bea-416c-912e-08c2a0ccb2ca None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.294819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac14f-4bea-416c-912e-08c2a0ccb2ca None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.295316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cac14f-4bea-416c-912e-08c2a0ccb2ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.296554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469542-4327-4eff-aba1-05f3928341b4 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:38.307921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cac14f-4bea-416c-912e-08c2a0ccb2ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:38.310289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cac14f-4bea-416c-912e-08c2a0ccb2ca None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:38.330892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97ea99-f3b6-4b08-9dcb-2a6a3e50133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:38.331592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97ea99-f3b6-4b08-9dcb-2a6a3e50133f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.331876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97ea99-f3b6-4b08-9dcb-2a6a3e50133f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.332147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97ea99-f3b6-4b08-9dcb-2a6a3e50133f None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.332583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-24cac14f-4bea-416c-912e-08c2a0ccb2ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:38.332861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97ea99-f3b6-4b08-9dcb-2a6a3e50133f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:38.333163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97ea99-f3b6-4b08-9dcb-2a6a3e50133f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:38.334539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97ea99-f3b6-4b08-9dcb-2a6a3e50133f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:38.334933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 274/556] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:38.340188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d86ea-52a4-4596-9b0c-9a35eb024284 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.340188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d86ea-52a4-4596-9b0c-9a35eb024284 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.340188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d86ea-52a4-4596-9b0c-9a35eb024284 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.341989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 275/557] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:38.342479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d86ea-52a4-4596-9b0c-9a35eb024284 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.354712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 283/558] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:38.356894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163a223-4114-4562-ad23-69ef151020a0 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.357404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163a223-4114-4562-ad23-69ef151020a0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.357897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163a223-4114-4562-ad23-69ef151020a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.379511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1163a223-4114-4562-ad23-69ef151020a0 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:38.381208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1163a223-4114-4562-ad23-69ef151020a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:38.446666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d86ea-52a4-4596-9b0c-9a35eb024284 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:38.464128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 284/559] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:38.465955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163a223-4114-4562-ad23-69ef151020a0 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.483088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea32d7-de11-43fd-ac45-df173810640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:38.483789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea32d7-de11-43fd-ac45-df173810640b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.484075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea32d7-de11-43fd-ac45-df173810640b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.484347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea32d7-de11-43fd-ac45-df173810640b None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.485126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea32d7-de11-43fd-ac45-df173810640b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:38.485429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea32d7-de11-43fd-ac45-df173810640b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:38.486919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea32d7-de11-43fd-ac45-df173810640b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:38.499446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 276/560] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:38.504530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b700d-0ca5-48ab-a43d-f73f2d7993f2 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.504530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b700d-0ca5-48ab-a43d-f73f2d7993f2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.504530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b700d-0ca5-48ab-a43d-f73f2d7993f2 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.504530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 277/561] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:38.504530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b700d-0ca5-48ab-a43d-f73f2d7993f2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.573037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163a223-4114-4562-ad23-69ef151020a0 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:38.601623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b700d-0ca5-48ab-a43d-f73f2d7993f2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:38.607737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2475a5-44ce-45a1-ae7d-742583ad3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:38.608531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2475a5-44ce-45a1-ae7d-742583ad3862 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.608819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2475a5-44ce-45a1-ae7d-742583ad3862 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.609089 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2475a5-44ce-45a1-ae7d-742583ad3862 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.616461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2475a5-44ce-45a1-ae7d-742583ad3862 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:38.617878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2475a5-44ce-45a1-ae7d-742583ad3862 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:38.631704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-ec2475a5-44ce-45a1-ae7d-742583ad3862 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 00:12:38.637407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 285/562] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:38.637407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2475a5-44ce-45a1-ae7d-742583ad3862 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.638402 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5593835-7d82-4c76-8417-4cb657a34754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:38.639199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593835-7d82-4c76-8417-4cb657a34754 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.639482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593835-7d82-4c76-8417-4cb657a34754 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.639759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5593835-7d82-4c76-8417-4cb657a34754 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.649572 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5593835-7d82-4c76-8417-4cb657a34754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:38.657020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-c5593835-7d82-4c76-8417-4cb657a34754 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:38.658530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 278/563] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:38.659718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f4cb0-5a45-4fad-a6e6-0789dd9ef7c9 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.660001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f4cb0-5a45-4fad-a6e6-0789dd9ef7c9 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.660277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f4cb0-5a45-4fad-a6e6-0789dd9ef7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.677875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-526f4cb0-5a45-4fad-a6e6-0789dd9ef7c9 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:38.679084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-526f4cb0-5a45-4fad-a6e6-0789dd9ef7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:38.742779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2475a5-44ce-45a1-ae7d-742583ad3862 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:38.744380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 279/564] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:38.745229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f4cb0-5a45-4fad-a6e6-0789dd9ef7c9 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.782774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb7c38-5b20-40b1-a3e3-fa6d13672a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:38.783562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb7c38-5b20-40b1-a3e3-fa6d13672a9b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.783841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb7c38-5b20-40b1-a3e3-fa6d13672a9b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.784119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb7c38-5b20-40b1-a3e3-fa6d13672a9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.790998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb7c38-5b20-40b1-a3e3-fa6d13672a9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:38.792466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb7c38-5b20-40b1-a3e3-fa6d13672a9b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:38.805441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-86bb7c38-5b20-40b1-a3e3-fa6d13672a9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:38.811711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 286/565] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:38.811711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb7c38-5b20-40b1-a3e3-fa6d13672a9b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.844907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f4cb0-5a45-4fad-a6e6-0789dd9ef7c9 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:38.878936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb7f1b-d049-465e-b6c9-88772777132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:38.879719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb7f1b-d049-465e-b6c9-88772777132a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.880007 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb7f1b-d049-465e-b6c9-88772777132a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.880283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb7f1b-d049-465e-b6c9-88772777132a None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.881133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb7f1b-d049-465e-b6c9-88772777132a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:38.881441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb7f1b-d049-465e-b6c9-88772777132a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:38.883338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb7f1b-d049-465e-b6c9-88772777132a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:38.905301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 280/566] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:38.905301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb7f1b-d049-465e-b6c9-88772777132a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:38.912017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb7c38-5b20-40b1-a3e3-fa6d13672a9b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:38.944452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d29674-aeef-43be-a857-29c66eee7c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:38.945128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d29674-aeef-43be-a857-29c66eee7c89 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:38.945409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d29674-aeef-43be-a857-29c66eee7c89 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:38.945681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d29674-aeef-43be-a857-29c66eee7c89 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:38.946445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d29674-aeef-43be-a857-29c66eee7c89 None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:38.946748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d29674-aeef-43be-a857-29c66eee7c89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:38.948100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d29674-aeef-43be-a857-29c66eee7c89 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:38.956557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 287/567] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:38.957329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d29674-aeef-43be-a857-29c66eee7c89 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.007606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb7f1b-d049-465e-b6c9-88772777132a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.040742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806b14a-3fe0-46a3-a70a-5bf47ebe8553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.041741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806b14a-3fe0-46a3-a70a-5bf47ebe8553 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.042174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806b14a-3fe0-46a3-a70a-5bf47ebe8553 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.042968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806b14a-3fe0-46a3-a70a-5bf47ebe8553 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.052440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806b14a-3fe0-46a3-a70a-5bf47ebe8553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:39.053565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d29674-aeef-43be-a857-29c66eee7c89 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.059891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-2806b14a-3fe0-46a3-a70a-5bf47ebe8553 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:39.065672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 281/568] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:39.065672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806b14a-3fe0-46a3-a70a-5bf47ebe8553 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.089319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caeeeae-7cc3-4c4f-800b-b1ca46437d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.089975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caeeeae-7cc3-4c4f-800b-b1ca46437d0b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.090271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caeeeae-7cc3-4c4f-800b-b1ca46437d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.090568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caeeeae-7cc3-4c4f-800b-b1ca46437d0b None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.091337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caeeeae-7cc3-4c4f-800b-b1ca46437d0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:39.091646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caeeeae-7cc3-4c4f-800b-b1ca46437d0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.093055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caeeeae-7cc3-4c4f-800b-b1ca46437d0b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.109973 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 288/569] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:39.109973 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caeeeae-7cc3-4c4f-800b-b1ca46437d0b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.164022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806b14a-3fe0-46a3-a70a-5bf47ebe8553 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.197834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f70831-b8d3-41d7-a763-75df8c01cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.198656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f70831-b8d3-41d7-a763-75df8c01cd61 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.198974 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f70831-b8d3-41d7-a763-75df8c01cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.199245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f70831-b8d3-41d7-a763-75df8c01cd61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.204512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caeeeae-7cc3-4c4f-800b-b1ca46437d0b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.209337 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f70831-b8d3-41d7-a763-75df8c01cd61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.210837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f70831-b8d3-41d7-a763-75df8c01cd61 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.226549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-a7f70831-b8d3-41d7-a763-75df8c01cd61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:39.232979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 282/570] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:39.232979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f70831-b8d3-41d7-a763-75df8c01cd61 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.238124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70d601-ccf9-4e84-b6a3-6455026e02be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.238995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70d601-ccf9-4e84-b6a3-6455026e02be None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.239278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70d601-ccf9-4e84-b6a3-6455026e02be None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.239544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70d601-ccf9-4e84-b6a3-6455026e02be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.250277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70d601-ccf9-4e84-b6a3-6455026e02be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.251714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70d601-ccf9-4e84-b6a3-6455026e02be None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.267870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-dd70d601-ccf9-4e84-b6a3-6455026e02be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:39.269046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 289/571] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:39.269799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70d601-ccf9-4e84-b6a3-6455026e02be None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.325920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f70831-b8d3-41d7-a763-75df8c01cd61 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.357418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f69c31-9e15-4bda-a1d4-fad4b7fb9da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.358074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f69c31-9e15-4bda-a1d4-fad4b7fb9da6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.358383 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f69c31-9e15-4bda-a1d4-fad4b7fb9da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.358658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f69c31-9e15-4bda-a1d4-fad4b7fb9da6 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.359392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f69c31-9e15-4bda-a1d4-fad4b7fb9da6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:39.359694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f69c31-9e15-4bda-a1d4-fad4b7fb9da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.361090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f69c31-9e15-4bda-a1d4-fad4b7fb9da6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.361371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70d601-ccf9-4e84-b6a3-6455026e02be None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.368465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 283/572] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:39.369233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f69c31-9e15-4bda-a1d4-fad4b7fb9da6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.392949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4221a-b278-4368-922c-82a62b687d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.393594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4221a-b278-4368-922c-82a62b687d10 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.393876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4221a-b278-4368-922c-82a62b687d10 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.394152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4221a-b278-4368-922c-82a62b687d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.395002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4221a-b278-4368-922c-82a62b687d10 None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=dc91dcec14694193a8e60e32fc138b8f) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:39.395314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4221a-b278-4368-922c-82a62b687d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.396717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4221a-b278-4368-922c-82a62b687d10 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.402603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 290/573] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/role_assignments?user.id=dc91dcec14694193a8e60e32fc138b8f&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:39.403641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93bae-a00f-4750-9842-9d18fd9a234e None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.403927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93bae-a00f-4750-9842-9d18fd9a234e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.404202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93bae-a00f-4750-9842-9d18fd9a234e None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.409510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 291/574] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:39.409510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd93bae-a00f-4750-9842-9d18fd9a234e None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.469293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f69c31-9e15-4bda-a1d4-fad4b7fb9da6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.503289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20628a52-ae0f-4fcc-b0c1-22ae132c4062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.503993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20628a52-ae0f-4fcc-b0c1-22ae132c4062 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.504250 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20628a52-ae0f-4fcc-b0c1-22ae132c4062 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.504525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20628a52-ae0f-4fcc-b0c1-22ae132c4062 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.505326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20628a52-ae0f-4fcc-b0c1-22ae132c4062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:39.505551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20628a52-ae0f-4fcc-b0c1-22ae132c4062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.507070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20628a52-ae0f-4fcc-b0c1-22ae132c4062 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.516012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd93bae-a00f-4750-9842-9d18fd9a234e None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.522620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 284/575] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:39.523902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20628a52-ae0f-4fcc-b0c1-22ae132c4062 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.550822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebedb742-1107-4801-8b8d-3ba05e405f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.551497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb742-1107-4801-8b8d-3ba05e405f96 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.551783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb742-1107-4801-8b8d-3ba05e405f96 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.552056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedb742-1107-4801-8b8d-3ba05e405f96 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.552788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb742-1107-4801-8b8d-3ba05e405f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:39.553095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb742-1107-4801-8b8d-3ba05e405f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.554516 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebedb742-1107-4801-8b8d-3ba05e405f96 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.566868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 292/576] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:39.568474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd20f-3466-403e-8ab3-6ba4545659ef None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.568974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd20f-3466-403e-8ab3-6ba4545659ef None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.569431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd20f-3466-403e-8ab3-6ba4545659ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.586444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-343fd20f-3466-403e-8ab3-6ba4545659ef None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:39.587620 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-343fd20f-3466-403e-8ab3-6ba4545659ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:39.634277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20628a52-ae0f-4fcc-b0c1-22ae132c4062 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.656990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 293/577] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:39.656990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fd20f-3466-403e-8ab3-6ba4545659ef None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.693104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b16c4-30a3-4aee-94e8-28bb70d729e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.694520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b16c4-30a3-4aee-94e8-28bb70d729e7 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.695147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b16c4-30a3-4aee-94e8-28bb70d729e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.695933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b16c4-30a3-4aee-94e8-28bb70d729e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.706697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b16c4-30a3-4aee-94e8-28bb70d729e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.708157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b16c4-30a3-4aee-94e8-28bb70d729e7 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.724761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-662b16c4-30a3-4aee-94e8-28bb70d729e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:39.731047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 285/578] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:39.731047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b16c4-30a3-4aee-94e8-28bb70d729e7 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.775395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fd20f-3466-403e-8ab3-6ba4545659ef None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.810371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f03e73-b9b3-44e0-b44e-edb8bce68cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.811164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f03e73-b9b3-44e0-b44e-edb8bce68cdf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.811448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f03e73-b9b3-44e0-b44e-edb8bce68cdf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.811721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f03e73-b9b3-44e0-b44e-edb8bce68cdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.818092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f03e73-b9b3-44e0-b44e-edb8bce68cdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.819558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f03e73-b9b3-44e0-b44e-edb8bce68cdf None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.824408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b16c4-30a3-4aee-94e8-28bb70d729e7 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.832682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-90f03e73-b9b3-44e0-b44e-edb8bce68cdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:39.838314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 294/579] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:39.838314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f03e73-b9b3-44e0-b44e-edb8bce68cdf None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.862146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822e60b-c577-49a7-9335-eb3d36c126c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.862990 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e60b-c577-49a7-9335-eb3d36c126c4 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.863275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e60b-c577-49a7-9335-eb3d36c126c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.863549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e60b-c577-49a7-9335-eb3d36c126c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.870358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822e60b-c577-49a7-9335-eb3d36c126c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:39.871819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822e60b-c577-49a7-9335-eb3d36c126c4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:39.885420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-6822e60b-c577-49a7-9335-eb3d36c126c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 00:12:39.891555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 286/580] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:39.891555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822e60b-c577-49a7-9335-eb3d36c126c4 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:39.937721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f03e73-b9b3-44e0-b44e-edb8bce68cdf None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.972483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f02db-d5e6-4a02-af28-fb99aa6ab629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:39.973267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f02db-d5e6-4a02-af28-fb99aa6ab629 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:39.973548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f02db-d5e6-4a02-af28-fb99aa6ab629 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:39.973830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f02db-d5e6-4a02-af28-fb99aa6ab629 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:39.981086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822e60b-c577-49a7-9335-eb3d36c126c4 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:39.983965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f02db-d5e6-4a02-af28-fb99aa6ab629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:39.990963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-e56f02db-d5e6-4a02-af28-fb99aa6ab629 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:39.994528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 295/581] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:39.995172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f02db-d5e6-4a02-af28-fb99aa6ab629 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.014859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df99b7-feeb-406b-85cf-8ee274f9de66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.015519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df99b7-feeb-406b-85cf-8ee274f9de66 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.015803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df99b7-feeb-406b-85cf-8ee274f9de66 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.016081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df99b7-feeb-406b-85cf-8ee274f9de66 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.016796 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df99b7-feeb-406b-85cf-8ee274f9de66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:40.017103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df99b7-feeb-406b-85cf-8ee274f9de66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.018493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df99b7-feeb-406b-85cf-8ee274f9de66 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.033609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 287/582] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:40.033609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df99b7-feeb-406b-85cf-8ee274f9de66 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.097685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f02db-d5e6-4a02-af28-fb99aa6ab629 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.125220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df99b7-feeb-406b-85cf-8ee274f9de66 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.131678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177dd66-090d-41df-9ede-8001b0539a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.132745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177dd66-090d-41df-9ede-8001b0539a84 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.133033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177dd66-090d-41df-9ede-8001b0539a84 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.133371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177dd66-090d-41df-9ede-8001b0539a84 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.134154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177dd66-090d-41df-9ede-8001b0539a84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:40.134537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177dd66-090d-41df-9ede-8001b0539a84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.136024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177dd66-090d-41df-9ede-8001b0539a84 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.148382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 296/583] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:40.149189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177dd66-090d-41df-9ede-8001b0539a84 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.162484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d440f-f291-43d7-ad47-4b2810001f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.163156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d440f-f291-43d7-ad47-4b2810001f91 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.163435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d440f-f291-43d7-ad47-4b2810001f91 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.163702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d440f-f291-43d7-ad47-4b2810001f91 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.164782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d440f-f291-43d7-ad47-4b2810001f91 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:40.165083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d440f-f291-43d7-ad47-4b2810001f91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.166519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8d440f-f291-43d7-ad47-4b2810001f91 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.187926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 288/584] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:40.187926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d440f-f291-43d7-ad47-4b2810001f91 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.247213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177dd66-090d-41df-9ede-8001b0539a84 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.279911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172320fd-6327-41a6-8def-632d2180ef1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.280580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172320fd-6327-41a6-8def-632d2180ef1e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.280864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172320fd-6327-41a6-8def-632d2180ef1e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.281143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172320fd-6327-41a6-8def-632d2180ef1e None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.281563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d440f-f291-43d7-ad47-4b2810001f91 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.281970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172320fd-6327-41a6-8def-632d2180ef1e None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:40.282295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172320fd-6327-41a6-8def-632d2180ef1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.283659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172320fd-6327-41a6-8def-632d2180ef1e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.297466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 297/585] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:40.297466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172320fd-6327-41a6-8def-632d2180ef1e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.315916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e467e4-ea76-4230-b25c-29912454f620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.316706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e467e4-ea76-4230-b25c-29912454f620 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.316987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e467e4-ea76-4230-b25c-29912454f620 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.317259 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e467e4-ea76-4230-b25c-29912454f620 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.324843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e467e4-ea76-4230-b25c-29912454f620 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.326285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e467e4-ea76-4230-b25c-29912454f620 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.339697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-e7e467e4-ea76-4230-b25c-29912454f620 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 00:12:40.345532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 289/586] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:40.345532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e467e4-ea76-4230-b25c-29912454f620 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.393039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172320fd-6327-41a6-8def-632d2180ef1e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.427430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9ea7-9e69-421c-a758-65d7ba7a622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.428324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9ea7-9e69-421c-a758-65d7ba7a622a None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.428608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9ea7-9e69-421c-a758-65d7ba7a622a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.428881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9ea7-9e69-421c-a758-65d7ba7a622a None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/dfaf01f45e7a429e9361eb176a3f7c38/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.444055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a9ea7-9e69-421c-a758-65d7ba7a622a None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=dfaf01f45e7a429e9361eb176a3f7c38, role_id=8ec0a126e9a54afab4f7ee9cd6bbc6c4)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.445488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a9ea7-9e69-421c-a758-65d7ba7a622a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.445935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e467e4-ea76-4230-b25c-29912454f620 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.458298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 298/587] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:12:40 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/dfaf01f45e7a429e9361eb176a3f7c38/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:40.459460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9ea7-9e69-421c-a758-65d7ba7a622a None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.484175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd515c-b750-4c77-b667-795d1356f412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.484953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd515c-b750-4c77-b667-795d1356f412 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.485277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd515c-b750-4c77-b667-795d1356f412 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.485557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd515c-b750-4c77-b667-795d1356f412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.498047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd515c-b750-4c77-b667-795d1356f412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.499666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd515c-b750-4c77-b667-795d1356f412 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.518730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-2cbd515c-b750-4c77-b667-795d1356f412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:40.524910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 290/588] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:40.525906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd515c-b750-4c77-b667-795d1356f412 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.577464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9ea7-9e69-421c-a758-65d7ba7a622a None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.618511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938af5e-32ce-4cf2-a762-577e220f4dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.619740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938af5e-32ce-4cf2-a762-577e220f4dda None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.620232 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938af5e-32ce-4cf2-a762-577e220f4dda None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.620888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938af5e-32ce-4cf2-a762-577e220f4dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.632059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938af5e-32ce-4cf2-a762-577e220f4dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.633898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938af5e-32ce-4cf2-a762-577e220f4dda None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.634477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd515c-b750-4c77-b667-795d1356f412 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.653122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-a938af5e-32ce-4cf2-a762-577e220f4dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:40.655069 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 299/589] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:40.656086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938af5e-32ce-4cf2-a762-577e220f4dda None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.671783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021fdce-65e9-4a2c-b12a-a717d1e4a1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.674623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021fdce-65e9-4a2c-b12a-a717d1e4a1b2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.674623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021fdce-65e9-4a2c-b12a-a717d1e4a1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.674623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021fdce-65e9-4a2c-b12a-a717d1e4a1b2 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.674623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021fdce-65e9-4a2c-b12a-a717d1e4a1b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:40.674623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021fdce-65e9-4a2c-b12a-a717d1e4a1b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.676567 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021fdce-65e9-4a2c-b12a-a717d1e4a1b2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.694027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 291/590] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:40.696464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021fdce-65e9-4a2c-b12a-a717d1e4a1b2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.778893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938af5e-32ce-4cf2-a762-577e220f4dda None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.803540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021fdce-65e9-4a2c-b12a-a717d1e4a1b2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.813347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce8f5c-92de-4be7-81dd-f2821bce283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.814050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce8f5c-92de-4be7-81dd-f2821bce283c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.814304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce8f5c-92de-4be7-81dd-f2821bce283c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.814579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce8f5c-92de-4be7-81dd-f2821bce283c None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.815298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce8f5c-92de-4be7-81dd-f2821bce283c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:40.815600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce8f5c-92de-4be7-81dd-f2821bce283c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.816941 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce8f5c-92de-4be7-81dd-f2821bce283c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.829194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 300/591] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:40.830226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce8f5c-92de-4be7-81dd-f2821bce283c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.841429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a431430-684f-4c66-9725-1afaa10ef1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.842491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a431430-684f-4c66-9725-1afaa10ef1af None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.843026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a431430-684f-4c66-9725-1afaa10ef1af None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.843534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a431430-684f-4c66-9725-1afaa10ef1af None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.844530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a431430-684f-4c66-9725-1afaa10ef1af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:40.845053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a431430-684f-4c66-9725-1afaa10ef1af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.846702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a431430-684f-4c66-9725-1afaa10ef1af None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.859117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 292/592] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:40.864466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a431430-684f-4c66-9725-1afaa10ef1af None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:40.929797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce8f5c-92de-4be7-81dd-f2821bce283c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.963167 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045db9-6be0-4fe3-9929-e8ff356e5aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:40.964002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045db9-6be0-4fe3-9929-e8ff356e5aaa None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:40.964821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045db9-6be0-4fe3-9929-e8ff356e5aaa None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:40.965135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21045db9-6be0-4fe3-9929-e8ff356e5aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:40.967168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a431430-684f-4c66-9725-1afaa10ef1af None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:40.975573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21045db9-6be0-4fe3-9929-e8ff356e5aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:40.977004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21045db9-6be0-4fe3-9929-e8ff356e5aaa None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:40.993595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-21045db9-6be0-4fe3-9929-e8ff356e5aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:40.998555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 301/593] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:40.999444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045db9-6be0-4fe3-9929-e8ff356e5aaa None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.002830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b644035-da15-479d-813f-08d1a8c7b78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.003863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b644035-da15-479d-813f-08d1a8c7b78b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.004370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b644035-da15-479d-813f-08d1a8c7b78b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.004845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b644035-da15-479d-813f-08d1a8c7b78b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.013049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b644035-da15-479d-813f-08d1a8c7b78b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.014759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b644035-da15-479d-813f-08d1a8c7b78b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.028659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-5b644035-da15-479d-813f-08d1a8c7b78b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:41.030421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 293/594] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:41.031382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b644035-da15-479d-813f-08d1a8c7b78b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.101759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21045db9-6be0-4fe3-9929-e8ff356e5aaa None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.131653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b644035-da15-479d-813f-08d1a8c7b78b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.135144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7b6c-e526-41f4-8165-8a5c4ac99b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.135949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7b6c-e526-41f4-8165-8a5c4ac99b5b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.136298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7b6c-e526-41f4-8165-8a5c4ac99b5b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.136570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7b6c-e526-41f4-8165-8a5c4ac99b5b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.144349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b7b6c-e526-41f4-8165-8a5c4ac99b5b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.145785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b7b6c-e526-41f4-8165-8a5c4ac99b5b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.159386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-882b7b6c-e526-41f4-8165-8a5c4ac99b5b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 00:12:41.165386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 302/595] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:41.165386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7b6c-e526-41f4-8165-8a5c4ac99b5b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.174155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20369-8845-447a-9799-7dc075d4440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.175150 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20369-8845-447a-9799-7dc075d4440c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.175678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20369-8845-447a-9799-7dc075d4440c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.176154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c20369-8845-447a-9799-7dc075d4440c None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.177205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c20369-8845-447a-9799-7dc075d4440c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:41.177760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c20369-8845-447a-9799-7dc075d4440c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.179372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c20369-8845-447a-9799-7dc075d4440c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.192481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 294/596] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:41.193911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20369-8845-447a-9799-7dc075d4440c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.267833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7b6c-e526-41f4-8165-8a5c4ac99b5b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.298097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c20369-8845-447a-9799-7dc075d4440c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.301483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46fb94-ade4-467d-ba60-2e5ac206990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.302159 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46fb94-ade4-467d-ba60-2e5ac206990d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.306287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46fb94-ade4-467d-ba60-2e5ac206990d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.306287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46fb94-ade4-467d-ba60-2e5ac206990d None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.306287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46fb94-ade4-467d-ba60-2e5ac206990d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:41.306287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46fb94-ade4-467d-ba60-2e5ac206990d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.306287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46fb94-ade4-467d-ba60-2e5ac206990d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.318689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 303/597] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:41.319556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46fb94-ade4-467d-ba60-2e5ac206990d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.342391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbcec7-d7ef-4c9e-bf31-29bb48586ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.343475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbcec7-d7ef-4c9e-bf31-29bb48586ceb None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.344523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbcec7-d7ef-4c9e-bf31-29bb48586ceb None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.345006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbcec7-d7ef-4c9e-bf31-29bb48586ceb None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.346559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbcec7-d7ef-4c9e-bf31-29bb48586ceb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:41.347256 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbcec7-d7ef-4c9e-bf31-29bb48586ceb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.349725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbcec7-d7ef-4c9e-bf31-29bb48586ceb None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.374311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 295/598] 10.222.0.32 () {56 vars in 1139 bytes} [Tue Apr 12 00:12:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:41.375229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbcec7-d7ef-4c9e-bf31-29bb48586ceb None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.423847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46fb94-ade4-467d-ba60-2e5ac206990d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.458858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36742613-07ba-47e1-9a71-fed9b41a53bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.459712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36742613-07ba-47e1-9a71-fed9b41a53bf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.460065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36742613-07ba-47e1-9a71-fed9b41a53bf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.460444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36742613-07ba-47e1-9a71-fed9b41a53bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.467371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36742613-07ba-47e1-9a71-fed9b41a53bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.468972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36742613-07ba-47e1-9a71-fed9b41a53bf None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.474477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbcec7-d7ef-4c9e-bf31-29bb48586ceb None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.482635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-36742613-07ba-47e1-9a71-fed9b41a53bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:41.484135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 304/599] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:41.484797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36742613-07ba-47e1-9a71-fed9b41a53bf None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.514535 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943c3bd-fb57-4df4-b726-2c47d1910ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.515425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943c3bd-fb57-4df4-b726-2c47d1910ff5 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.515706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943c3bd-fb57-4df4-b726-2c47d1910ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.515978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943c3bd-fb57-4df4-b726-2c47d1910ff5 None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/73a39479834440ffa85fbc0d58a257d7/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.531052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943c3bd-fb57-4df4-b726-2c47d1910ff5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=73a39479834440ffa85fbc0d58a257d7, role_id=8ec0a126e9a54afab4f7ee9cd6bbc6c4)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.532504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943c3bd-fb57-4df4-b726-2c47d1910ff5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.552122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 296/600] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:12:41 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/73a39479834440ffa85fbc0d58a257d7/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:41.553172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943c3bd-fb57-4df4-b726-2c47d1910ff5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.628405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36742613-07ba-47e1-9a71-fed9b41a53bf None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.682632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943c3bd-fb57-4df4-b726-2c47d1910ff5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.716565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f2b51-27ef-4924-a5a9-c30c233774d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.717289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2b51-27ef-4924-a5a9-c30c233774d4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.717569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2b51-27ef-4924-a5a9-c30c233774d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.717843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2b51-27ef-4924-a5a9-c30c233774d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.729296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09987f-84b7-4442-b3cb-5fb8b5cfb0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.729511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f2b51-27ef-4924-a5a9-c30c233774d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.730060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09987f-84b7-4442-b3cb-5fb8b5cfb0b6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.730427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09987f-84b7-4442-b3cb-5fb8b5cfb0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.730707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09987f-84b7-4442-b3cb-5fb8b5cfb0b6 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.730957 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f2b51-27ef-4924-a5a9-c30c233774d4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.731694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09987f-84b7-4442-b3cb-5fb8b5cfb0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:41.732009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09987f-84b7-4442-b3cb-5fb8b5cfb0b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.734109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09987f-84b7-4442-b3cb-5fb8b5cfb0b6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.748887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-da5f2b51-27ef-4924-a5a9-c30c233774d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:41.750483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 305/602] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:41.751820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe3280-109a-4722-8746-185eab93f607 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.752100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe3280-109a-4722-8746-185eab93f607 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.752427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe3280-109a-4722-8746-185eab93f607 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.753494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 297/602] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:41.753891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 306/603] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:41.755177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09987f-84b7-4442-b3cb-5fb8b5cfb0b6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.758960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe3280-109a-4722-8746-185eab93f607 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.874865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09987f-84b7-4442-b3cb-5fb8b5cfb0b6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.877744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe3280-109a-4722-8746-185eab93f607 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.907566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4440a43-72b4-422b-a85d-d209be4f20e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.908506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4440a43-72b4-422b-a85d-d209be4f20e5 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.908785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4440a43-72b4-422b-a85d-d209be4f20e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.909106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4440a43-72b4-422b-a85d-d209be4f20e5 None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/ecf0479293de4edfbf2815c1e9f2f7cc/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.916999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce3632-24ff-4728-b45c-15ebfbae802e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.918689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce3632-24ff-4728-b45c-15ebfbae802e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.918971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce3632-24ff-4728-b45c-15ebfbae802e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.919245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce3632-24ff-4728-b45c-15ebfbae802e None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.920278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce3632-24ff-4728-b45c-15ebfbae802e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:41.920756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce3632-24ff-4728-b45c-15ebfbae802e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.922814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce3632-24ff-4728-b45c-15ebfbae802e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.924154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4440a43-72b4-422b-a85d-d209be4f20e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=ecf0479293de4edfbf2815c1e9f2f7cc, role_id=8ec0a126e9a54afab4f7ee9cd6bbc6c4)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.925572 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4440a43-72b4-422b-a85d-d209be4f20e5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.937248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 307/604] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:41.938699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d04601-f767-458d-983b-badc18c862fb None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.938982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d04601-f767-458d-983b-badc18c862fb None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.939304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d04601-f767-458d-983b-badc18c862fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.941029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 298/605] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:12:41 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/ecf0479293de4edfbf2815c1e9f2f7cc/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:41.947543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4440a43-72b4-422b-a85d-d209be4f20e5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.987518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-55d04601-f767-458d-983b-badc18c862fb None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:41.988657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-55d04601-f767-458d-983b-badc18c862fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:42.081136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4440a43-72b4-422b-a85d-d209be4f20e5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:42.121063 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b372ddd-dc14-4740-ad37-674e6c0faf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:42.121917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b372ddd-dc14-4740-ad37-674e6c0faf7b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:42.122198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b372ddd-dc14-4740-ad37-674e6c0faf7b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:42.123739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b372ddd-dc14-4740-ad37-674e6c0faf7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:42.130579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b372ddd-dc14-4740-ad37-674e6c0faf7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:42.132523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b372ddd-dc14-4740-ad37-674e6c0faf7b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:42.148340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-6b372ddd-dc14-4740-ad37-674e6c0faf7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:42.150518 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 299/606] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:42.158110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 308/607] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:42.160810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b372ddd-dc14-4740-ad37-674e6c0faf7b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:42.180640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d04601-f767-458d-983b-badc18c862fb None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:42.285318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d04601-f767-458d-983b-badc18c862fb None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:42.297014 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b372ddd-dc14-4740-ad37-674e6c0faf7b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:42.324440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459d844-fd15-42f7-97b5-f82b8001751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:42.325246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459d844-fd15-42f7-97b5-f82b8001751f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:42.325528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459d844-fd15-42f7-97b5-f82b8001751f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:42.325799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459d844-fd15-42f7-97b5-f82b8001751f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:42.342695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459d844-fd15-42f7-97b5-f82b8001751f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:42.350802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-8459d844-fd15-42f7-97b5-f82b8001751f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:42.354061 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fba5d-7335-45a5-b1f3-072bff534adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:42.354760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fba5d-7335-45a5-b1f3-072bff534adc None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:42.355072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fba5d-7335-45a5-b1f3-072bff534adc None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:42.355349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fba5d-7335-45a5-b1f3-072bff534adc None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:42.356252 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fba5d-7335-45a5-b1f3-072bff534adc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:42.356568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fba5d-7335-45a5-b1f3-072bff534adc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:42.358005 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fba5d-7335-45a5-b1f3-072bff534adc None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:42.360603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 309/608] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:42.361770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459d844-fd15-42f7-97b5-f82b8001751f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:42.383879 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 300/609] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:42.392415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fba5d-7335-45a5-b1f3-072bff534adc None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:42.520325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fba5d-7335-45a5-b1f3-072bff534adc None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:42.546369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459d844-fd15-42f7-97b5-f82b8001751f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:42.562081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab40cd-3405-474f-992c-8c415caead30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:42.563013 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab40cd-3405-474f-992c-8c415caead30 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:42.563296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab40cd-3405-474f-992c-8c415caead30 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:42.563575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab40cd-3405-474f-992c-8c415caead30 None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/a99a9951d83446efbf819b72836afc2b/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:42.587665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c487e5c-419f-4d1c-b218-4421ba291190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:42.589720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487e5c-419f-4d1c-b218-4421ba291190 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:42.590827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab40cd-3405-474f-992c-8c415caead30 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=a99a9951d83446efbf819b72836afc2b, role_id=8ec0a126e9a54afab4f7ee9cd6bbc6c4)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:42.592557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487e5c-419f-4d1c-b218-4421ba291190 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:42.593092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487e5c-419f-4d1c-b218-4421ba291190 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:42.594088 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c487e5c-419f-4d1c-b218-4421ba291190 None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:42.594621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c487e5c-419f-4d1c-b218-4421ba291190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:42.596306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c487e5c-419f-4d1c-b218-4421ba291190 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:42.598652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab40cd-3405-474f-992c-8c415caead30 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:42.611337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 310/610] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:42.618982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c487e5c-419f-4d1c-b218-4421ba291190 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:42.629570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 301/611] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:12:42 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/a99a9951d83446efbf819b72836afc2b/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:42.777492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c487e5c-419f-4d1c-b218-4421ba291190 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:42.824517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0d56e-67c4-41c0-9faa-945eff66d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:42.825294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0d56e-67c4-41c0-9faa-945eff66d09e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:42.825578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0d56e-67c4-41c0-9faa-945eff66d09e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:42.825846 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0d56e-67c4-41c0-9faa-945eff66d09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:42.837318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0d56e-67c4-41c0-9faa-945eff66d09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:42.838788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0d56e-67c4-41c0-9faa-945eff66d09e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:42.856161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-fad0d56e-67c4-41c0-9faa-945eff66d09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:42.857734 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 311/612] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:42.863571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab40cd-3405-474f-992c-8c415caead30 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:42.964620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab40cd-3405-474f-992c-8c415caead30 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:42.999389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424cb85-b7c3-4d71-a591-b1950ce0a917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:43.000061 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424cb85-b7c3-4d71-a591-b1950ce0a917 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:43.000341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424cb85-b7c3-4d71-a591-b1950ce0a917 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:43.000613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424cb85-b7c3-4d71-a591-b1950ce0a917 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:43.001332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424cb85-b7c3-4d71-a591-b1950ce0a917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:43.001690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424cb85-b7c3-4d71-a591-b1950ce0a917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:43.003122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e424cb85-b7c3-4d71-a591-b1950ce0a917 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:43.014789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 302/613] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:43.020193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0d56e-67c4-41c0-9faa-945eff66d09e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:43.129854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0d56e-67c4-41c0-9faa-945eff66d09e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:43.161497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a2b14-38dc-4842-9230-6dfec52212ec None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:43.161837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a2b14-38dc-4842-9230-6dfec52212ec None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:43.162055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a2b14-38dc-4842-9230-6dfec52212ec None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:43.163673 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 303/614] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:43.171398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f502c8-da08-4277-8a69-faf40b72b57c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:43.171692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f502c8-da08-4277-8a69-faf40b72b57c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:43.171975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f502c8-da08-4277-8a69-faf40b72b57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:43.174034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec755ad-1fe6-4174-8bbf-6c5bbde924ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:43.174949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec755ad-1fe6-4174-8bbf-6c5bbde924ce None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:43.175234 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec755ad-1fe6-4174-8bbf-6c5bbde924ce None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:43.175503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec755ad-1fe6-4174-8bbf-6c5bbde924ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:43.183939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec755ad-1fe6-4174-8bbf-6c5bbde924ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:43.186422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec755ad-1fe6-4174-8bbf-6c5bbde924ce None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:43.200440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-7ec755ad-1fe6-4174-8bbf-6c5bbde924ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 00:12:43.202043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 312/615] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:43.207277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-70f502c8-da08-4277-8a69-faf40b72b57c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:43.207433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec755ad-1fe6-4174-8bbf-6c5bbde924ce None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:43.208485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-70f502c8-da08-4277-8a69-faf40b72b57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:43.329013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec755ad-1fe6-4174-8bbf-6c5bbde924ce None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:43.341968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 304/616] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:43.369413 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d97e-b88b-420b-94e5-936904eb0b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:43.370326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d97e-b88b-420b-94e5-936904eb0b60 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:43.370656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d97e-b88b-420b-94e5-936904eb0b60 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:43.370926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9d97e-b88b-420b-94e5-936904eb0b60 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:43.372169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d97e-b88b-420b-94e5-936904eb0b60 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:43.372500 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d97e-b88b-420b-94e5-936904eb0b60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:43.374288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9d97e-b88b-420b-94e5-936904eb0b60 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:43.393783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 313/617] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 00:12:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:43.399175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f502c8-da08-4277-8a69-faf40b72b57c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:43.410733 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d97e-b88b-420b-94e5-936904eb0b60 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:43.523767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f502c8-da08-4277-8a69-faf40b72b57c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:43.558636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3219950-6328-40f2-8c84-6d0f059a8721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:43.559433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3219950-6328-40f2-8c84-6d0f059a8721 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:43.559708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3219950-6328-40f2-8c84-6d0f059a8721 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:43.559979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3219950-6328-40f2-8c84-6d0f059a8721 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:43.570048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3219950-6328-40f2-8c84-6d0f059a8721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:43.577444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-d3219950-6328-40f2-8c84-6d0f059a8721 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:43.578965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 305/618] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:43.585695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3219950-6328-40f2-8c84-6d0f059a8721 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:43.613959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9d97e-b88b-420b-94e5-936904eb0b60 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:43.650532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded01526-17dc-41e8-a9e2-80e22bfe87a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:43.651354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded01526-17dc-41e8-a9e2-80e22bfe87a2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:43.651658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded01526-17dc-41e8-a9e2-80e22bfe87a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:43.652463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded01526-17dc-41e8-a9e2-80e22bfe87a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:43.676342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded01526-17dc-41e8-a9e2-80e22bfe87a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:43.677936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded01526-17dc-41e8-a9e2-80e22bfe87a2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:43.696777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-ded01526-17dc-41e8-a9e2-80e22bfe87a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:43.698280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 314/619] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:43.705754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded01526-17dc-41e8-a9e2-80e22bfe87a2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:43.774627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3219950-6328-40f2-8c84-6d0f059a8721 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:43.823416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836fd9-f6bc-4a99-abe9-2f10ce0bcb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:43.824154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836fd9-f6bc-4a99-abe9-2f10ce0bcb6e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:43.824431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836fd9-f6bc-4a99-abe9-2f10ce0bcb6e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:43.824704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1836fd9-f6bc-4a99-abe9-2f10ce0bcb6e None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:43.825458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836fd9-f6bc-4a99-abe9-2f10ce0bcb6e None admin] RBAC: Adding query filter params (name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:43.825757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836fd9-f6bc-4a99-abe9-2f10ce0bcb6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:43.827154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1836fd9-f6bc-4a99-abe9-2f10ce0bcb6e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:43.848229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 306/620] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:43.854291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836fd9-f6bc-4a99-abe9-2f10ce0bcb6e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:43.886480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded01526-17dc-41e8-a9e2-80e22bfe87a2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:43.924946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bcdf0-207f-4c1b-b4ab-2e5fdae718cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:43.925533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bcdf0-207f-4c1b-b4ab-2e5fdae718cb None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:43.925869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bcdf0-207f-4c1b-b4ab-2e5fdae718cb None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:43.926143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bcdf0-207f-4c1b-b4ab-2e5fdae718cb None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:43.926898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bcdf0-207f-4c1b-b4ab-2e5fdae718cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:43.927538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bcdf0-207f-4c1b-b4ab-2e5fdae718cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:43.929059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25bcdf0-207f-4c1b-b4ab-2e5fdae718cb None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:43.941982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 315/621] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:43.947607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bcdf0-207f-4c1b-b4ab-2e5fdae718cb None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:44.061695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bcdf0-207f-4c1b-b4ab-2e5fdae718cb None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:44.097022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792511bb-8967-4acd-94b2-735f2028044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:44.097823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792511bb-8967-4acd-94b2-735f2028044b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.098104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792511bb-8967-4acd-94b2-735f2028044b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.098402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792511bb-8967-4acd-94b2-735f2028044b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.106177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792511bb-8967-4acd-94b2-735f2028044b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:44.108196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792511bb-8967-4acd-94b2-735f2028044b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:44.112150 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1836fd9-f6bc-4a99-abe9-2f10ce0bcb6e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:44.122912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-792511bb-8967-4acd-94b2-735f2028044b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:44.124464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 316/622] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:44.130123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792511bb-8967-4acd-94b2-735f2028044b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:44.200390 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff94aa-3b28-40eb-b7d8-3ef565461fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:44.201591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff94aa-3b28-40eb-b7d8-3ef565461fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.202082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff94aa-3b28-40eb-b7d8-3ef565461fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.202589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff94aa-3b28-40eb-b7d8-3ef565461fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.228244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff94aa-3b28-40eb-b7d8-3ef565461fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:44.230601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff94aa-3b28-40eb-b7d8-3ef565461fc1 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:44.235205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792511bb-8967-4acd-94b2-735f2028044b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:44.266801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-37ff94aa-3b28-40eb-b7d8-3ef565461fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:44.268675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 307/623] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:44.270326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd864-68e7-4ba0-ba91-2f200ac382a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:44.270989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd864-68e7-4ba0-ba91-2f200ac382a6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.271268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd864-68e7-4ba0-ba91-2f200ac382a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.271541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd864-68e7-4ba0-ba91-2f200ac382a6 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.272316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddd864-68e7-4ba0-ba91-2f200ac382a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:44.272680 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddd864-68e7-4ba0-ba91-2f200ac382a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:44.274151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddd864-68e7-4ba0-ba91-2f200ac382a6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:44.275856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff94aa-3b28-40eb-b7d8-3ef565461fc1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:44.286882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 317/624] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:44.294192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd864-68e7-4ba0-ba91-2f200ac382a6 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:44.398870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd864-68e7-4ba0-ba91-2f200ac382a6 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:44.434065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9974d8c-04ce-4328-aeac-291b71c4aafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:44.434990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974d8c-04ce-4328-aeac-291b71c4aafc None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.435266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974d8c-04ce-4328-aeac-291b71c4aafc None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.435537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9974d8c-04ce-4328-aeac-291b71c4aafc None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/dc91dcec14694193a8e60e32fc138b8f/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.439806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff94aa-3b28-40eb-b7d8-3ef565461fc1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:44.453367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9974d8c-04ce-4328-aeac-291b71c4aafc None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=dc91dcec14694193a8e60e32fc138b8f, role_id=8ec0a126e9a54afab4f7ee9cd6bbc6c4)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:44.455167 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9974d8c-04ce-4328-aeac-291b71c4aafc None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:44.469087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 318/625] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:12:44 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/dc91dcec14694193a8e60e32fc138b8f/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:12:44.470544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dbb76-32cc-46fc-ae32-0a189ccefc48 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.470836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dbb76-32cc-46fc-ae32-0a189ccefc48 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.471197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dbb76-32cc-46fc-ae32-0a189ccefc48 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.476914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 319/626] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:44.479086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a481c1a-e317-4c25-b51a-c07b71ca3ee0 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.479376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a481c1a-e317-4c25-b51a-c07b71ca3ee0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.479706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a481c1a-e317-4c25-b51a-c07b71ca3ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.483655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7b406-3453-44f2-82af-8f5d026fa7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:44.484561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7b406-3453-44f2-82af-8f5d026fa7bd None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.485032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7b406-3453-44f2-82af-8f5d026fa7bd None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.485491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7b406-3453-44f2-82af-8f5d026fa7bd None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.487712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7b406-3453-44f2-82af-8f5d026fa7bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:44.488293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7b406-3453-44f2-82af-8f5d026fa7bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:44.489917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7b406-3453-44f2-82af-8f5d026fa7bd None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:44.499779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-6a481c1a-e317-4c25-b51a-c07b71ca3ee0 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:44.500888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6a481c1a-e317-4c25-b51a-c07b71ca3ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:44.506049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 308/627] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:44.511877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7b406-3453-44f2-82af-8f5d026fa7bd None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:44.576810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 320/628] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:44.618810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a481c1a-e317-4c25-b51a-c07b71ca3ee0 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:44.659345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7b406-3453-44f2-82af-8f5d026fa7bd None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:44.727713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67914e29-46db-453d-a953-4181dbba7a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:44.728447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67914e29-46db-453d-a953-4181dbba7a4a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.728731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67914e29-46db-453d-a953-4181dbba7a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.729003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67914e29-46db-453d-a953-4181dbba7a4a None admin] PATH_INFO: `/v3/users/glance` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.737120 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67914e29-46db-453d-a953-4181dbba7a4a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:44.738362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a481c1a-e317-4c25-b51a-c07b71ca3ee0 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:44.738623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67914e29-46db-453d-a953-4181dbba7a4a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:44.753853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-67914e29-46db-453d-a953-4181dbba7a4a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 12 00:12:44.756013 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 309/629] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:44.763526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67914e29-46db-453d-a953-4181dbba7a4a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:44.784966 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7bdd5-af9a-49e5-a18a-026000769a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:44.786616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7bdd5-af9a-49e5-a18a-026000769a8a None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.787115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7bdd5-af9a-49e5-a18a-026000769a8a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.787880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7bdd5-af9a-49e5-a18a-026000769a8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.802701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7bdd5-af9a-49e5-a18a-026000769a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:44.811557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-48c7bdd5-af9a-49e5-a18a-026000769a8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:44.813841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 321/630] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:44.820754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7bdd5-af9a-49e5-a18a-026000769a8a None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:44.895674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67914e29-46db-453d-a953-4181dbba7a4a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:44.938981 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd4992-0ad9-4baf-b6fd-7fe00e98b1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:44.940523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4992-0ad9-4baf-b6fd-7fe00e98b1f0 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.941153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4992-0ad9-4baf-b6fd-7fe00e98b1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.941750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd4992-0ad9-4baf-b6fd-7fe00e98b1f0 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.943279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd4992-0ad9-4baf-b6fd-7fe00e98b1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:44.944043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd4992-0ad9-4baf-b6fd-7fe00e98b1f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:44.946355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd4992-0ad9-4baf-b6fd-7fe00e98b1f0 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:44.949054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7bdd5-af9a-49e5-a18a-026000769a8a None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:44.974309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 310/631] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 00:12:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:44.975858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebd136-4db8-4b80-a629-a59311d3d6ed None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.976145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebd136-4db8-4b80-a629-a59311d3d6ed None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:44.976419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebd136-4db8-4b80-a629-a59311d3d6ed None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:44.978211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 311/632] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:44.983327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebd136-4db8-4b80-a629-a59311d3d6ed None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:44.997843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c157714-9860-4e82-b78a-9cfd8ff0c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:44.999485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c157714-9860-4e82-b78a-9cfd8ff0c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:44.999986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c157714-9860-4e82-b78a-9cfd8ff0c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.000446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c157714-9860-4e82-b78a-9cfd8ff0c8d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.001653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c157714-9860-4e82-b78a-9cfd8ff0c8d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:45.002585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c157714-9860-4e82-b78a-9cfd8ff0c8d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:45.004462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c157714-9860-4e82-b78a-9cfd8ff0c8d9 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:45.016263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 322/633] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:45.021105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731e7f-ce57-4cb8-8aa3-2bd7df1a5a0f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.021105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731e7f-ce57-4cb8-8aa3-2bd7df1a5a0f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.021105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731e7f-ce57-4cb8-8aa3-2bd7df1a5a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.038623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e3731e7f-ce57-4cb8-8aa3-2bd7df1a5a0f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:45.039838 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e3731e7f-ce57-4cb8-8aa3-2bd7df1a5a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:45.101330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebd136-4db8-4b80-a629-a59311d3d6ed None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:45.114377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 323/634] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:45.115276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3731e7f-ce57-4cb8-8aa3-2bd7df1a5a0f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.137010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f38dda-65c4-4fe5-addc-b2139bfbd2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:45.138018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f38dda-65c4-4fe5-addc-b2139bfbd2db None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.138555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f38dda-65c4-4fe5-addc-b2139bfbd2db None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.139035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f38dda-65c4-4fe5-addc-b2139bfbd2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.206386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f38dda-65c4-4fe5-addc-b2139bfbd2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:45.208176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f38dda-65c4-4fe5-addc-b2139bfbd2db None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:45.233105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3731e7f-ce57-4cb8-8aa3-2bd7df1a5a0f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:45.266377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f1649-e0e9-4c38-8073-fc9d36f506a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:45.267204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f1649-e0e9-4c38-8073-fc9d36f506a7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.267485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f1649-e0e9-4c38-8073-fc9d36f506a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.267755 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f1649-e0e9-4c38-8073-fc9d36f506a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.278512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f1649-e0e9-4c38-8073-fc9d36f506a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:45.280036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f1649-e0e9-4c38-8073-fc9d36f506a7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:45.297250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-ae2f1649-e0e9-4c38-8073-fc9d36f506a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:45.303117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 324/635] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:45.303117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f1649-e0e9-4c38-8073-fc9d36f506a7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.317631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 312/636] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:45.318924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f38dda-65c4-4fe5-addc-b2139bfbd2db None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.406785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f1649-e0e9-4c38-8073-fc9d36f506a7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:45.420945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f38dda-65c4-4fe5-addc-b2139bfbd2db None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:45.441840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9511ec-e830-4ded-b81b-6a73e4b2d835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:45.442671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9511ec-e830-4ded-b81b-6a73e4b2d835 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.442972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9511ec-e830-4ded-b81b-6a73e4b2d835 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.443236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9511ec-e830-4ded-b81b-6a73e4b2d835 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.453136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9511ec-e830-4ded-b81b-6a73e4b2d835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:45.456774 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970d751-b63b-4a4b-a44a-be8b2f6a372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:45.457657 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d751-b63b-4a4b-a44a-be8b2f6a372e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.458122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d751-b63b-4a4b-a44a-be8b2f6a372e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.458598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970d751-b63b-4a4b-a44a-be8b2f6a372e None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.459491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970d751-b63b-4a4b-a44a-be8b2f6a372e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:45.459994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970d751-b63b-4a4b-a44a-be8b2f6a372e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:45.460167 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-fd9511ec-e830-4ded-b81b-6a73e4b2d835 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:45.461388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 325/637] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:45.461886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970d751-b63b-4a4b-a44a-be8b2f6a372e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:45.462150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9511ec-e830-4ded-b81b-6a73e4b2d835 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.476643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 313/638] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:45.477954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd3ea6-557f-4c6e-b930-0c455cc41a1a None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.478267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd3ea6-557f-4c6e-b930-0c455cc41a1a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.478553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd3ea6-557f-4c6e-b930-0c455cc41a1a None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.481562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 314/639] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:45.481562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd3ea6-557f-4c6e-b930-0c455cc41a1a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.571275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9511ec-e830-4ded-b81b-6a73e4b2d835 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:45.579070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd3ea6-557f-4c6e-b930-0c455cc41a1a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:45.605313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31af2f-e72d-4114-8cdc-bfeb41881ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:45.606110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31af2f-e72d-4114-8cdc-bfeb41881ae4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.606421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31af2f-e72d-4114-8cdc-bfeb41881ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.606695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31af2f-e72d-4114-8cdc-bfeb41881ae4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.612378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda0d99-5471-4c12-8979-314dcb9f832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:45.613266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda0d99-5471-4c12-8979-314dcb9f832c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.613730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda0d99-5471-4c12-8979-314dcb9f832c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.614183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda0d99-5471-4c12-8979-314dcb9f832c None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.615171 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda0d99-5471-4c12-8979-314dcb9f832c None admin] RBAC: Adding query filter params (name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:45.615548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda0d99-5471-4c12-8979-314dcb9f832c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:45.616928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda0d99-5471-4c12-8979-314dcb9f832c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:45.617046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31af2f-e72d-4114-8cdc-bfeb41881ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:45.618491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a31af2f-e72d-4114-8cdc-bfeb41881ae4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:45.629050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 315/640] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:45.629050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda0d99-5471-4c12-8979-314dcb9f832c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.639378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-1a31af2f-e72d-4114-8cdc-bfeb41881ae4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:45.644792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 326/641] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:45.644792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7062c-52d1-4777-9108-5c337781a961 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.644792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7062c-52d1-4777-9108-5c337781a961 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.644792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7062c-52d1-4777-9108-5c337781a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.659672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ccf7062c-52d1-4777-9108-5c337781a961 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:45.661005 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ccf7062c-52d1-4777-9108-5c337781a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:45.726320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 327/642] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:45.727461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7062c-52d1-4777-9108-5c337781a961 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.745362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda0d99-5471-4c12-8979-314dcb9f832c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:45.787062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec121-cf76-4e03-8ad0-30d7c0ba04db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:45.787860 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec121-cf76-4e03-8ad0-30d7c0ba04db None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.788143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec121-cf76-4e03-8ad0-30d7c0ba04db None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.788560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec121-cf76-4e03-8ad0-30d7c0ba04db None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.796583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeec121-cf76-4e03-8ad0-30d7c0ba04db None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:45.798034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeec121-cf76-4e03-8ad0-30d7c0ba04db None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:45.811862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-0aeec121-cf76-4e03-8ad0-30d7c0ba04db None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 00:12:45.817444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 316/643] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:45.817444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec121-cf76-4e03-8ad0-30d7c0ba04db None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.829153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7062c-52d1-4777-9108-5c337781a961 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:45.862499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fd249-6f53-4296-99fd-86f7446ce2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:45.863286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fd249-6f53-4296-99fd-86f7446ce2bf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.863567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fd249-6f53-4296-99fd-86f7446ce2bf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.863839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fd249-6f53-4296-99fd-86f7446ce2bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.873895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fd249-6f53-4296-99fd-86f7446ce2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:45.875338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0fd249-6f53-4296-99fd-86f7446ce2bf None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:45.891837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-1a0fd249-6f53-4296-99fd-86f7446ce2bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:45.897382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 328/644] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:45.897382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fd249-6f53-4296-99fd-86f7446ce2bf None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.916409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec121-cf76-4e03-8ad0-30d7c0ba04db None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:45.952453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8f29b-ab5d-4fe0-8df3-86e396549f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:45.953224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8f29b-ab5d-4fe0-8df3-86e396549f84 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:45.953507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8f29b-ab5d-4fe0-8df3-86e396549f84 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:45.953930 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8f29b-ab5d-4fe0-8df3-86e396549f84 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:45.954967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8f29b-ab5d-4fe0-8df3-86e396549f84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:45.955532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8f29b-ab5d-4fe0-8df3-86e396549f84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:45.956879 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8f29b-ab5d-4fe0-8df3-86e396549f84 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:45.970145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 317/645] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:45.971219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8f29b-ab5d-4fe0-8df3-86e396549f84 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:45.994138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fd249-6f53-4296-99fd-86f7446ce2bf None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.027141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396f159-c30f-4644-b70d-c693d4508ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.027937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396f159-c30f-4644-b70d-c693d4508ee2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.028224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396f159-c30f-4644-b70d-c693d4508ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.028504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396f159-c30f-4644-b70d-c693d4508ee2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.038221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396f159-c30f-4644-b70d-c693d4508ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:46.045961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-e396f159-c30f-4644-b70d-c693d4508ee2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:46.052305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 329/646] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:46.052305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396f159-c30f-4644-b70d-c693d4508ee2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.069064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8f29b-ab5d-4fe0-8df3-86e396549f84 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.102101 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7fced-5812-4cb3-91aa-5cb41cf991b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.102733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7fced-5812-4cb3-91aa-5cb41cf991b2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.103020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7fced-5812-4cb3-91aa-5cb41cf991b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.103301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7fced-5812-4cb3-91aa-5cb41cf991b2 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.104126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7fced-5812-4cb3-91aa-5cb41cf991b2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:46.104437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7fced-5812-4cb3-91aa-5cb41cf991b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.106469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7fced-5812-4cb3-91aa-5cb41cf991b2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.127283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 318/647] 10.222.0.32 () {56 vars in 1137 bytes} [Tue Apr 12 00:12:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:46.127283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7fced-5812-4cb3-91aa-5cb41cf991b2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.162539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396f159-c30f-4644-b70d-c693d4508ee2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.195049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfd1f0-522a-4778-8e14-9aa4673dc5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.195717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfd1f0-522a-4778-8e14-9aa4673dc5f5 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.196000 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfd1f0-522a-4778-8e14-9aa4673dc5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.196274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfd1f0-522a-4778-8e14-9aa4673dc5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.196999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfd1f0-522a-4778-8e14-9aa4673dc5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:46.197307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfd1f0-522a-4778-8e14-9aa4673dc5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.198740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfd1f0-522a-4778-8e14-9aa4673dc5f5 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.211027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 330/648] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:46.211840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfd1f0-522a-4778-8e14-9aa4673dc5f5 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.227921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7fced-5812-4cb3-91aa-5cb41cf991b2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.263684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5375-6b1b-41c2-999a-03f2abe97c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.265375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5375-6b1b-41c2-999a-03f2abe97c5f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.265845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5375-6b1b-41c2-999a-03f2abe97c5f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.266489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff5375-6b1b-41c2-999a-03f2abe97c5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.276439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff5375-6b1b-41c2-999a-03f2abe97c5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.279326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff5375-6b1b-41c2-999a-03f2abe97c5f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.296471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-11ff5375-6b1b-41c2-999a-03f2abe97c5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:46.298349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 319/649] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:46.299544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5375-6b1b-41c2-999a-03f2abe97c5f None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.306712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfd1f0-522a-4778-8e14-9aa4673dc5f5 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.340153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ddec6-c9ef-4947-a04f-854bab1e183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.340823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ddec6-c9ef-4947-a04f-854bab1e183d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.341102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ddec6-c9ef-4947-a04f-854bab1e183d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.341371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ddec6-c9ef-4947-a04f-854bab1e183d None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.342103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ddec6-c9ef-4947-a04f-854bab1e183d None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:46.342440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ddec6-c9ef-4947-a04f-854bab1e183d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.343773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ddec6-c9ef-4947-a04f-854bab1e183d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.356351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 331/650] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:46.356351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ddec6-c9ef-4947-a04f-854bab1e183d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.402919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff5375-6b1b-41c2-999a-03f2abe97c5f None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.437417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cf071-4b23-4530-9d85-980f08ed6a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.438578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cf071-4b23-4530-9d85-980f08ed6a90 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.439068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cf071-4b23-4530-9d85-980f08ed6a90 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.439543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cf071-4b23-4530-9d85-980f08ed6a90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.472991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ddec6-c9ef-4947-a04f-854bab1e183d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.515701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159f21c-d1c7-45c4-a1ff-4c97c9ca0e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.516563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159f21c-d1c7-45c4-a1ff-4c97c9ca0e39 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.516770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159f21c-d1c7-45c4-a1ff-4c97c9ca0e39 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.517094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159f21c-d1c7-45c4-a1ff-4c97c9ca0e39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.524917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cf071-4b23-4530-9d85-980f08ed6a90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.526516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cf071-4b23-4530-9d85-980f08ed6a90 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.528619 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159f21c-d1c7-45c4-a1ff-4c97c9ca0e39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.530706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159f21c-d1c7-45c4-a1ff-4c97c9ca0e39 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.545003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-8159f21c-d1c7-45c4-a1ff-4c97c9ca0e39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 00:12:46.550786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 332/651] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:46.551646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159f21c-d1c7-45c4-a1ff-4c97c9ca0e39 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.630215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 320/652] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:46.631583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cf071-4b23-4530-9d85-980f08ed6a90 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.661632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159f21c-d1c7-45c4-a1ff-4c97c9ca0e39 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.708848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b6dc8-8e41-4661-afa2-0168fe0a6031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.709551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b6dc8-8e41-4661-afa2-0168fe0a6031 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.709862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b6dc8-8e41-4661-afa2-0168fe0a6031 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.710117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b6dc8-8e41-4661-afa2-0168fe0a6031 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.710933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b6dc8-8e41-4661-afa2-0168fe0a6031 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:46.711242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b6dc8-8e41-4661-afa2-0168fe0a6031 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.712664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133b6dc8-8e41-4661-afa2-0168fe0a6031 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.725666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 333/653] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:46.726536 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b6dc8-8e41-4661-afa2-0168fe0a6031 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.771450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cf071-4b23-4530-9d85-980f08ed6a90 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.809496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e1dae-b494-495f-946f-468ad40f7b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.810323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e1dae-b494-495f-946f-468ad40f7b10 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.810608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e1dae-b494-495f-946f-468ad40f7b10 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.810890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e1dae-b494-495f-946f-468ad40f7b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.821041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e1dae-b494-495f-946f-468ad40f7b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.822441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e1dae-b494-495f-946f-468ad40f7b10 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.828725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133b6dc8-8e41-4661-afa2-0168fe0a6031 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.839989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-334e1dae-b494-495f-946f-468ad40f7b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:46.841191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 321/654] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:46.841956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e1dae-b494-495f-946f-468ad40f7b10 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.869255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff0f82-6bdb-4d6f-b8d2-47c15b7d2fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.869955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff0f82-6bdb-4d6f-b8d2-47c15b7d2fa4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.870210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff0f82-6bdb-4d6f-b8d2-47c15b7d2fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.871037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff0f82-6bdb-4d6f-b8d2-47c15b7d2fa4 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.871872 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff0f82-6bdb-4d6f-b8d2-47c15b7d2fa4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:46.872179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff0f82-6bdb-4d6f-b8d2-47c15b7d2fa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.873599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff0f82-6bdb-4d6f-b8d2-47c15b7d2fa4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.891435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 334/655] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:46.892464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff0f82-6bdb-4d6f-b8d2-47c15b7d2fa4 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:46.939431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e1dae-b494-495f-946f-468ad40f7b10 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:46.972100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a17d09-2f6a-4546-bf74-56081d9c235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:46.972893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a17d09-2f6a-4546-bf74-56081d9c235a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:46.973180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a17d09-2f6a-4546-bf74-56081d9c235a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:46.973457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a17d09-2f6a-4546-bf74-56081d9c235a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:46.983563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a17d09-2f6a-4546-bf74-56081d9c235a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:46.985000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a17d09-2f6a-4546-bf74-56081d9c235a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:46.987683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff0f82-6bdb-4d6f-b8d2-47c15b7d2fa4 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.001107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-c4a17d09-2f6a-4546-bf74-56081d9c235a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:47.002295 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 322/656] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:47.003064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a17d09-2f6a-4546-bf74-56081d9c235a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.019654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed3f9c-eb97-405d-8bee-abf700541201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.020311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed3f9c-eb97-405d-8bee-abf700541201 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.020590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed3f9c-eb97-405d-8bee-abf700541201 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.020862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed3f9c-eb97-405d-8bee-abf700541201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.021678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed3f9c-eb97-405d-8bee-abf700541201 None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=dfaf01f45e7a429e9361eb176a3f7c38) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:47.021987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed3f9c-eb97-405d-8bee-abf700541201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.023446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed3f9c-eb97-405d-8bee-abf700541201 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:47.029515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 335/657] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:46 2022] GET /identity/v3/role_assignments?user.id=dfaf01f45e7a429e9361eb176a3f7c38&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:47.030293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed3f9c-eb97-405d-8bee-abf700541201 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.109867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a17d09-2f6a-4546-bf74-56081d9c235a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.144840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed3f9c-eb97-405d-8bee-abf700541201 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.146066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa27363-d4d3-4100-aaa3-8d8fc9d7b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.146772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa27363-d4d3-4100-aaa3-8d8fc9d7b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.147057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa27363-d4d3-4100-aaa3-8d8fc9d7b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.147322 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa27363-d4d3-4100-aaa3-8d8fc9d7b8e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.148053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa27363-d4d3-4100-aaa3-8d8fc9d7b8e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:47.148352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa27363-d4d3-4100-aaa3-8d8fc9d7b8e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.149743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa27363-d4d3-4100-aaa3-8d8fc9d7b8e2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:47.166465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 323/658] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:47.166465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6f3f3-a25e-41e3-8d08-313f0c3fe715 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.166465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6f3f3-a25e-41e3-8d08-313f0c3fe715 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.166465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6f3f3-a25e-41e3-8d08-313f0c3fe715 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.166465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 324/659] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:47.166906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6f3f3-a25e-41e3-8d08-313f0c3fe715 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.189876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cfbf8c-8816-4c97-8ba1-fac1834d5dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.191076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfbf8c-8816-4c97-8ba1-fac1834d5dab None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.191368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfbf8c-8816-4c97-8ba1-fac1834d5dab None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.191643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cfbf8c-8816-4c97-8ba1-fac1834d5dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.272421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfbf8c-8816-4c97-8ba1-fac1834d5dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.273914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cfbf8c-8816-4c97-8ba1-fac1834d5dab None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:47.279323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6f3f3-a25e-41e3-8d08-313f0c3fe715 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.314759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c3e4-00ac-40b3-931c-9649acfce4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.315451 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c3e4-00ac-40b3-931c-9649acfce4a8 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.315736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c3e4-00ac-40b3-931c-9649acfce4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.316010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647c3e4-00ac-40b3-931c-9649acfce4a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.316731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647c3e4-00ac-40b3-931c-9649acfce4a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:47.317033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647c3e4-00ac-40b3-931c-9649acfce4a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.318455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647c3e4-00ac-40b3-931c-9649acfce4a8 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:47.335093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 325/660] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:47.335093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c3e4-00ac-40b3-931c-9649acfce4a8 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.382245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 336/661] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:47.382245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba87b2-1482-43ed-9bd4-1021858630ae None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.382245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba87b2-1482-43ed-9bd4-1021858630ae None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.382245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba87b2-1482-43ed-9bd4-1021858630ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.397938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-83ba87b2-1482-43ed-9bd4-1021858630ae None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:47.399068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-83ba87b2-1482-43ed-9bd4-1021858630ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:47.432152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647c3e4-00ac-40b3-931c-9649acfce4a8 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.465020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 337/662] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:47.465866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba87b2-1482-43ed-9bd4-1021858630ae None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.470029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69414182-f04e-42d4-9ac3-01617742b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.471211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69414182-f04e-42d4-9ac3-01617742b787 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.471707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69414182-f04e-42d4-9ac3-01617742b787 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.472176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69414182-f04e-42d4-9ac3-01617742b787 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.481609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69414182-f04e-42d4-9ac3-01617742b787 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.483735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69414182-f04e-42d4-9ac3-01617742b787 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:47.500008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-69414182-f04e-42d4-9ac3-01617742b787 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 12 00:12:47.505662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 326/663] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:47.505662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69414182-f04e-42d4-9ac3-01617742b787 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.562515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba87b2-1482-43ed-9bd4-1021858630ae None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.594954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a292d-79d7-4ccc-87df-e0ba0bf446e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.595750 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a292d-79d7-4ccc-87df-e0ba0bf446e6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.596044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a292d-79d7-4ccc-87df-e0ba0bf446e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.596312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a292d-79d7-4ccc-87df-e0ba0bf446e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.601014 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69414182-f04e-42d4-9ac3-01617742b787 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.602792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a292d-79d7-4ccc-87df-e0ba0bf446e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.604219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a292d-79d7-4ccc-87df-e0ba0bf446e6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:47.616943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-d62a292d-79d7-4ccc-87df-e0ba0bf446e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:47.618123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 338/664] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:47.618908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a292d-79d7-4ccc-87df-e0ba0bf446e6 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.640409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4e4f-97af-406b-b004-fda7b4fe01e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.641553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4e4f-97af-406b-b004-fda7b4fe01e1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.642029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4e4f-97af-406b-b004-fda7b4fe01e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.642527 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4e4f-97af-406b-b004-fda7b4fe01e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.652652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca4e4f-97af-406b-b004-fda7b4fe01e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.653897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca4e4f-97af-406b-b004-fda7b4fe01e1 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:47.673137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-6dca4e4f-97af-406b-b004-fda7b4fe01e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:47.678826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 327/665] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:47.678826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4e4f-97af-406b-b004-fda7b4fe01e1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.722940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a292d-79d7-4ccc-87df-e0ba0bf446e6 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.755322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba2834-7b82-4ce3-9685-b9211d3ba197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.756117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba2834-7b82-4ce3-9685-b9211d3ba197 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.756399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba2834-7b82-4ce3-9685-b9211d3ba197 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.756672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba2834-7b82-4ce3-9685-b9211d3ba197 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.768229 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba2834-7b82-4ce3-9685-b9211d3ba197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:47.775329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-39ba2834-7b82-4ce3-9685-b9211d3ba197 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:47.776556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 339/666] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:47.777368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba2834-7b82-4ce3-9685-b9211d3ba197 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.790718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4e4f-97af-406b-b004-fda7b4fe01e1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.824327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d70e56-3367-4d69-bcc1-0181136cce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.824997 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d70e56-3367-4d69-bcc1-0181136cce05 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.825278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d70e56-3367-4d69-bcc1-0181136cce05 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.825550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d70e56-3367-4d69-bcc1-0181136cce05 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.826415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d70e56-3367-4d69-bcc1-0181136cce05 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:47.826720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d70e56-3367-4d69-bcc1-0181136cce05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.828147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d70e56-3367-4d69-bcc1-0181136cce05 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:47.844867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 328/667] 10.222.0.32 () {56 vars in 1139 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:47.845681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d70e56-3367-4d69-bcc1-0181136cce05 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.881336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba2834-7b82-4ce3-9685-b9211d3ba197 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.914617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43609d-ed84-4dce-abb1-8c6db5dbcd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.915201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43609d-ed84-4dce-abb1-8c6db5dbcd2f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.915477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43609d-ed84-4dce-abb1-8c6db5dbcd2f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.915812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43609d-ed84-4dce-abb1-8c6db5dbcd2f None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.916583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43609d-ed84-4dce-abb1-8c6db5dbcd2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:47.916932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43609d-ed84-4dce-abb1-8c6db5dbcd2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.918410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43609d-ed84-4dce-abb1-8c6db5dbcd2f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:47.930137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 340/668] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:47.931213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43609d-ed84-4dce-abb1-8c6db5dbcd2f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:47.949529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d70e56-3367-4d69-bcc1-0181136cce05 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:47.983232 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d69ef-4f9e-42b7-a338-b176a592f769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:47.983908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d69ef-4f9e-42b7-a338-b176a592f769 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:47.984447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d69ef-4f9e-42b7-a338-b176a592f769 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:47.984447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d69ef-4f9e-42b7-a338-b176a592f769 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:47.985164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d69ef-4f9e-42b7-a338-b176a592f769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:47.985471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d69ef-4f9e-42b7-a338-b176a592f769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:47.986872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d69ef-4f9e-42b7-a338-b176a592f769 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.002154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 329/669] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:48.002154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d69ef-4f9e-42b7-a338-b176a592f769 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.033238 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43609d-ed84-4dce-abb1-8c6db5dbcd2f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.067046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d689-0412-41e6-aa83-75f01e9d0576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.067714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d689-0412-41e6-aa83-75f01e9d0576 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.067992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d689-0412-41e6-aa83-75f01e9d0576 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.068262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947d689-0412-41e6-aa83-75f01e9d0576 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.069005 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947d689-0412-41e6-aa83-75f01e9d0576 None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:48.069304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947d689-0412-41e6-aa83-75f01e9d0576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.070675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947d689-0412-41e6-aa83-75f01e9d0576 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.083130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 341/670] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:48.083130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d689-0412-41e6-aa83-75f01e9d0576 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.102286 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d69ef-4f9e-42b7-a338-b176a592f769 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.134563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ca30d-5c35-4457-a3ac-7fe813fe1e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.135227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ca30d-5c35-4457-a3ac-7fe813fe1e1a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.135509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ca30d-5c35-4457-a3ac-7fe813fe1e1a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.135786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ca30d-5c35-4457-a3ac-7fe813fe1e1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.181517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947d689-0412-41e6-aa83-75f01e9d0576 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.201206 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ca30d-5c35-4457-a3ac-7fe813fe1e1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.202736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ca30d-5c35-4457-a3ac-7fe813fe1e1a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.218897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21e4b1-2755-49dc-bc81-56d6187eae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.219830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21e4b1-2755-49dc-bc81-56d6187eae45 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.220114 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21e4b1-2755-49dc-bc81-56d6187eae45 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.220533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21e4b1-2755-49dc-bc81-56d6187eae45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.221656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21e4b1-2755-49dc-bc81-56d6187eae45 None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=73a39479834440ffa85fbc0d58a257d7) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:48.221970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21e4b1-2755-49dc-bc81-56d6187eae45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.223417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21e4b1-2755-49dc-bc81-56d6187eae45 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.230193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 342/671] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/role_assignments?user.id=73a39479834440ffa85fbc0d58a257d7&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:48.231006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21e4b1-2755-49dc-bc81-56d6187eae45 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.319925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 330/672] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:48.321289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ca30d-5c35-4457-a3ac-7fe813fe1e1a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.339100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21e4b1-2755-49dc-bc81-56d6187eae45 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.375263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d244c25-e8e0-4743-b057-971167cdac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.376081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d244c25-e8e0-4743-b057-971167cdac30 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.376366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d244c25-e8e0-4743-b057-971167cdac30 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.376644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d244c25-e8e0-4743-b057-971167cdac30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.384266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d244c25-e8e0-4743-b057-971167cdac30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.385738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d244c25-e8e0-4743-b057-971167cdac30 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.400568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2d244c25-e8e0-4743-b057-971167cdac30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:48.401868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 343/673] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:48.402996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d244c25-e8e0-4743-b057-971167cdac30 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.428513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ca30d-5c35-4457-a3ac-7fe813fe1e1a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.464133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448038e6-9506-4086-b1f8-b5ddec7a97c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.464860 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448038e6-9506-4086-b1f8-b5ddec7a97c0 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.465142 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448038e6-9506-4086-b1f8-b5ddec7a97c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.465420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448038e6-9506-4086-b1f8-b5ddec7a97c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.475461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448038e6-9506-4086-b1f8-b5ddec7a97c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.476906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448038e6-9506-4086-b1f8-b5ddec7a97c0 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.493580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-448038e6-9506-4086-b1f8-b5ddec7a97c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:48.495110 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 331/674] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:48.496446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448038e6-9506-4086-b1f8-b5ddec7a97c0 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.504714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d244c25-e8e0-4743-b057-971167cdac30 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.539959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0033e-842d-4466-a3bd-cb42a6c9f627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.540754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0033e-842d-4466-a3bd-cb42a6c9f627 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.541034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0033e-842d-4466-a3bd-cb42a6c9f627 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.541310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0033e-842d-4466-a3bd-cb42a6c9f627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.551600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0033e-842d-4466-a3bd-cb42a6c9f627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.553057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0033e-842d-4466-a3bd-cb42a6c9f627 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.570717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-3fa0033e-842d-4466-a3bd-cb42a6c9f627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:48.572010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 344/675] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:48.572779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0033e-842d-4466-a3bd-cb42a6c9f627 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.605326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448038e6-9506-4086-b1f8-b5ddec7a97c0 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.639730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84245c7d-8e83-414e-a034-c04a170ac070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.640404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84245c7d-8e83-414e-a034-c04a170ac070 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.640682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84245c7d-8e83-414e-a034-c04a170ac070 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.640958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84245c7d-8e83-414e-a034-c04a170ac070 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.641742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84245c7d-8e83-414e-a034-c04a170ac070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:48.642046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84245c7d-8e83-414e-a034-c04a170ac070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.643529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84245c7d-8e83-414e-a034-c04a170ac070 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.660995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 332/676] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:48.661914 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84245c7d-8e83-414e-a034-c04a170ac070 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.685461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0033e-842d-4466-a3bd-cb42a6c9f627 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.721461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7581d0e-531e-4fa5-9572-cefd4f7d62f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.722402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7581d0e-531e-4fa5-9572-cefd4f7d62f4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.722832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7581d0e-531e-4fa5-9572-cefd4f7d62f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.723253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7581d0e-531e-4fa5-9572-cefd4f7d62f4 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.724124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7581d0e-531e-4fa5-9572-cefd4f7d62f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:48.724575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7581d0e-531e-4fa5-9572-cefd4f7d62f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.726203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7581d0e-531e-4fa5-9572-cefd4f7d62f4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.737888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 345/677] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:48.738913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7581d0e-531e-4fa5-9572-cefd4f7d62f4 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.766702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84245c7d-8e83-414e-a034-c04a170ac070 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.800135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107b819-6f1a-466b-a003-c3661e084641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.800801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107b819-6f1a-466b-a003-c3661e084641 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.801048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107b819-6f1a-466b-a003-c3661e084641 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.801320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107b819-6f1a-466b-a003-c3661e084641 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.802174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107b819-6f1a-466b-a003-c3661e084641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:48.802382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107b819-6f1a-466b-a003-c3661e084641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.803759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107b819-6f1a-466b-a003-c3661e084641 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.820280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 333/678] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:48.821187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107b819-6f1a-466b-a003-c3661e084641 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.842743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7581d0e-531e-4fa5-9572-cefd4f7d62f4 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.877241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acd1ef-3ffa-4fa8-ba10-71921033fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.878174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acd1ef-3ffa-4fa8-ba10-71921033fb9f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.878630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acd1ef-3ffa-4fa8-ba10-71921033fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.879054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acd1ef-3ffa-4fa8-ba10-71921033fb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:48.880023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acd1ef-3ffa-4fa8-ba10-71921033fb9f None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=ecf0479293de4edfbf2815c1e9f2f7cc) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:48.880514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acd1ef-3ffa-4fa8-ba10-71921033fb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:48.882119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acd1ef-3ffa-4fa8-ba10-71921033fb9f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:48.889022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 346/679] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/role_assignments?user.id=ecf0479293de4edfbf2815c1e9f2f7cc&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:48.889955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acd1ef-3ffa-4fa8-ba10-71921033fb9f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:48.945799 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107b819-6f1a-466b-a003-c3661e084641 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:48.991952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df045e4-6b7e-49c0-a38d-614c3fd003c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:48.993027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df045e4-6b7e-49c0-a38d-614c3fd003c4 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:48.993464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df045e4-6b7e-49c0-a38d-614c3fd003c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:48.993889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df045e4-6b7e-49c0-a38d-614c3fd003c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.011201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df045e4-6b7e-49c0-a38d-614c3fd003c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:49.012994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df045e4-6b7e-49c0-a38d-614c3fd003c4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:49.046382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-6df045e4-6b7e-49c0-a38d-614c3fd003c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 00:12:49.047257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acd1ef-3ffa-4fa8-ba10-71921033fb9f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:49.051667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 334/680] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:49.060466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df045e4-6b7e-49c0-a38d-614c3fd003c4 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:49.135020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230b56e-adc7-43a4-862c-681dae517182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:49.136101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230b56e-adc7-43a4-862c-681dae517182 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:49.136482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230b56e-adc7-43a4-862c-681dae517182 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:49.136855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230b56e-adc7-43a4-862c-681dae517182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.146601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230b56e-adc7-43a4-862c-681dae517182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:49.148283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230b56e-adc7-43a4-862c-681dae517182 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:49.165839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-e230b56e-adc7-43a4-862c-681dae517182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:49.168196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 347/681] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:49.173280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230b56e-adc7-43a4-862c-681dae517182 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:49.222905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df045e4-6b7e-49c0-a38d-614c3fd003c4 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:49.261877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db901cb-7fcd-47cf-8634-918e4b3cf5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:49.262549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db901cb-7fcd-47cf-8634-918e4b3cf5ec None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:49.262832 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db901cb-7fcd-47cf-8634-918e4b3cf5ec None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:49.263112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db901cb-7fcd-47cf-8634-918e4b3cf5ec None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.263958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db901cb-7fcd-47cf-8634-918e4b3cf5ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:49.264261 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db901cb-7fcd-47cf-8634-918e4b3cf5ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:49.265716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db901cb-7fcd-47cf-8634-918e4b3cf5ec None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:49.289624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 335/682] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 00:12:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:49.295822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db901cb-7fcd-47cf-8634-918e4b3cf5ec None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:49.310843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230b56e-adc7-43a4-862c-681dae517182 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:49.345145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e659215-8c6d-4ca3-9e47-076defb06fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:49.345807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e659215-8c6d-4ca3-9e47-076defb06fb7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:49.346087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e659215-8c6d-4ca3-9e47-076defb06fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:49.346385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e659215-8c6d-4ca3-9e47-076defb06fb7 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.347163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e659215-8c6d-4ca3-9e47-076defb06fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:49.347461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e659215-8c6d-4ca3-9e47-076defb06fb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:49.348889 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e659215-8c6d-4ca3-9e47-076defb06fb7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:49.361400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 348/683] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:49.367444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e659215-8c6d-4ca3-9e47-076defb06fb7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:49.400337 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db901cb-7fcd-47cf-8634-918e4b3cf5ec None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:49.434780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb905b-d705-4469-a98f-4a56d6542806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:49.435439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb905b-d705-4469-a98f-4a56d6542806 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:49.435724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb905b-d705-4469-a98f-4a56d6542806 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:49.436002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb905b-d705-4469-a98f-4a56d6542806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.469558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e659215-8c6d-4ca3-9e47-076defb06fb7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:49.502687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18b26e-813c-40f0-ba98-3b4288b97fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:49.503361 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18b26e-813c-40f0-ba98-3b4288b97fea None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:49.503643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18b26e-813c-40f0-ba98-3b4288b97fea None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:49.503917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18b26e-813c-40f0-ba98-3b4288b97fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.504753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18b26e-813c-40f0-ba98-3b4288b97fea None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=a99a9951d83446efbf819b72836afc2b) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:49.505061 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18b26e-813c-40f0-ba98-3b4288b97fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:49.506538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18b26e-813c-40f0-ba98-3b4288b97fea None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:49.513570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb905b-d705-4469-a98f-4a56d6542806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:49.513848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 349/684] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:49 2022] GET /identity/v3/role_assignments?user.id=a99a9951d83446efbf819b72836afc2b&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:49.515055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb905b-d705-4469-a98f-4a56d6542806 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:49.515264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60192a8-cb02-432f-887a-4b58e025f297 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:49.515519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60192a8-cb02-432f-887a-4b58e025f297 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:49.515802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60192a8-cb02-432f-887a-4b58e025f297 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.522725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 350/685] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:49.528528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ef2c-94c9-4539-af46-e80816ed0c3a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:49.528842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ef2c-94c9-4539-af46-e80816ed0c3a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:49.529068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ef2c-94c9-4539-af46-e80816ed0c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.555807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d1e2ef2c-94c9-4539-af46-e80816ed0c3a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:49.557000 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d1e2ef2c-94c9-4539-af46-e80816ed0c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:49.622805 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 336/686] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:49.635357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb905b-d705-4469-a98f-4a56d6542806 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:49.674965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 351/687] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:49.699580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ef2c-94c9-4539-af46-e80816ed0c3a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:49.801319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb905b-d705-4469-a98f-4a56d6542806 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:49.848464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ef2c-94c9-4539-af46-e80816ed0c3a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:49.852837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9572c3-c4d6-464a-9045-31faba401af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:49.853559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9572c3-c4d6-464a-9045-31faba401af4 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:49.853840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9572c3-c4d6-464a-9045-31faba401af4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:49.854114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9572c3-c4d6-464a-9045-31faba401af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.871276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9572c3-c4d6-464a-9045-31faba401af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:49.872743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9572c3-c4d6-464a-9045-31faba401af4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:49.891108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-de9572c3-c4d6-464a-9045-31faba401af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:49.892655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 337/688] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:49.896162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f365-b8f9-4ce7-92ac-f84b58bd5718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:49.897379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f365-b8f9-4ce7-92ac-f84b58bd5718 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:49.897870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f365-b8f9-4ce7-92ac-f84b58bd5718 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:49.897975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9572c3-c4d6-464a-9045-31faba401af4 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:49.898550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f365-b8f9-4ce7-92ac-f84b58bd5718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:49.909435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08f365-b8f9-4ce7-92ac-f84b58bd5718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:49.911325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08f365-b8f9-4ce7-92ac-f84b58bd5718 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:49.928655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-5f08f365-b8f9-4ce7-92ac-f84b58bd5718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:49.930488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 352/689] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:49.936392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f365-b8f9-4ce7-92ac-f84b58bd5718 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:50.007253 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9572c3-c4d6-464a-9045-31faba401af4 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:50.045893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438c481-7ba6-4f79-a7ac-15e8595395e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:50.046627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c481-7ba6-4f79-a7ac-15e8595395e6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:50.046916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c481-7ba6-4f79-a7ac-15e8595395e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:50.047198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c481-7ba6-4f79-a7ac-15e8595395e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:50.047926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438c481-7ba6-4f79-a7ac-15e8595395e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:50.048233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438c481-7ba6-4f79-a7ac-15e8595395e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:50.049685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438c481-7ba6-4f79-a7ac-15e8595395e6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:50.063533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f365-b8f9-4ce7-92ac-f84b58bd5718 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:50.064088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 338/690] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:50.068855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438c481-7ba6-4f79-a7ac-15e8595395e6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:50.106001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b36410-705c-4e5a-8adb-68e9058cc737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:50.107039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b36410-705c-4e5a-8adb-68e9058cc737 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:50.107517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b36410-705c-4e5a-8adb-68e9058cc737 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:50.107985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b36410-705c-4e5a-8adb-68e9058cc737 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:50.109327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b36410-705c-4e5a-8adb-68e9058cc737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:50.109858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b36410-705c-4e5a-8adb-68e9058cc737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:50.111801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b36410-705c-4e5a-8adb-68e9058cc737 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:50.127116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 353/691] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:50.135192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b36410-705c-4e5a-8adb-68e9058cc737 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:50.172742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438c481-7ba6-4f79-a7ac-15e8595395e6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:50.207186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdc9d1-b1b8-4867-b5d8-60cfc93115d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:50.208043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdc9d1-b1b8-4867-b5d8-60cfc93115d2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:50.208332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdc9d1-b1b8-4867-b5d8-60cfc93115d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:50.208610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdc9d1-b1b8-4867-b5d8-60cfc93115d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:50.215768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdc9d1-b1b8-4867-b5d8-60cfc93115d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:50.217334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdc9d1-b1b8-4867-b5d8-60cfc93115d2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:50.231943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-eecdc9d1-b1b8-4867-b5d8-60cfc93115d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:50.233491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 339/692] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:50.242138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdc9d1-b1b8-4867-b5d8-60cfc93115d2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:50.269959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b36410-705c-4e5a-8adb-68e9058cc737 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:50.303669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40d09-220f-40f8-8baa-189313153fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:50.304683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40d09-220f-40f8-8baa-189313153fb0 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:50.305160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40d09-220f-40f8-8baa-189313153fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:50.305626 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40d09-220f-40f8-8baa-189313153fb0 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:50.306572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a40d09-220f-40f8-8baa-189313153fb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:50.308318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a40d09-220f-40f8-8baa-189313153fb0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:50.335037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 354/693] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:12:50 2022] POST /identity/v3/users => generated 254 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:50.414951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdc9d1-b1b8-4867-b5d8-60cfc93115d2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:50.464682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38764f72-a167-4410-bbd1-67bf74188940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:50.465718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38764f72-a167-4410-bbd1-67bf74188940 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:50.466229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38764f72-a167-4410-bbd1-67bf74188940 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:50.466724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38764f72-a167-4410-bbd1-67bf74188940 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:50.467714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38764f72-a167-4410-bbd1-67bf74188940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:50.468239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38764f72-a167-4410-bbd1-67bf74188940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:50.469888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38764f72-a167-4410-bbd1-67bf74188940 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:50.483718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 340/694] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:50.491346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40d09-220f-40f8-8baa-189313153fb0 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:50.618624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40d09-220f-40f8-8baa-189313153fb0 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:50.663291 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545b108-32bf-43d0-9d2e-115c282b9912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:50.664574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b108-32bf-43d0-9d2e-115c282b9912 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:50.665078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b108-32bf-43d0-9d2e-115c282b9912 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:50.665562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545b108-32bf-43d0-9d2e-115c282b9912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:50.666646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b108-32bf-43d0-9d2e-115c282b9912 None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=dc91dcec14694193a8e60e32fc138b8f) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:50.667245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b108-32bf-43d0-9d2e-115c282b9912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:50.668942 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545b108-32bf-43d0-9d2e-115c282b9912 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:50.675785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 355/695] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:50 2022] GET /identity/v3/role_assignments?user.id=dc91dcec14694193a8e60e32fc138b8f&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:50.787866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41a455-babe-49aa-804a-ffea824619ab None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:50.788219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41a455-babe-49aa-804a-ffea824619ab None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:50.788427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41a455-babe-49aa-804a-ffea824619ab None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:50.790066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 341/696] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:50.797939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03fc74-0747-4b0d-a2c4-455d1405532f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:50.798276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03fc74-0747-4b0d-a2c4-455d1405532f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:50.798538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03fc74-0747-4b0d-a2c4-455d1405532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:50.818953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-9a03fc74-0747-4b0d-a2c4-455d1405532f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:50.820186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9a03fc74-0747-4b0d-a2c4-455d1405532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:50.895764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 356/697] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:50.921572 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41a455-babe-49aa-804a-ffea824619ab None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:51.052510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41a455-babe-49aa-804a-ffea824619ab None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:51.086131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8765321-2559-4921-b16c-61479fc22800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:51.086967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8765321-2559-4921-b16c-61479fc22800 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:51.087245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8765321-2559-4921-b16c-61479fc22800 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:51.087515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8765321-2559-4921-b16c-61479fc22800 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:51.088163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8765321-2559-4921-b16c-61479fc22800 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:51.089598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8765321-2559-4921-b16c-61479fc22800 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:51.102639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-c8765321-2559-4921-b16c-61479fc22800 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 00:12:51.109333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 342/698] 10.222.0.32 () {56 vars in 1129 bytes} [Tue Apr 12 00:12:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:51.111997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03fc74-0747-4b0d-a2c4-455d1405532f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:51.256290 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03fc74-0747-4b0d-a2c4-455d1405532f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:51.289946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab73c3-7038-4817-baec-573bbab28a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:51.290643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab73c3-7038-4817-baec-573bbab28a2c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:51.290923 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab73c3-7038-4817-baec-573bbab28a2c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:51.291197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab73c3-7038-4817-baec-573bbab28a2c None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:51.291890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab73c3-7038-4817-baec-573bbab28a2c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:51.292322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab73c3-7038-4817-baec-573bbab28a2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:51.293707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab73c3-7038-4817-baec-573bbab28a2c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:51.298363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 357/699] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 00:12:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:51.303664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8765321-2559-4921-b16c-61479fc22800 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:51.449415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8765321-2559-4921-b16c-61479fc22800 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:51.494594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593281da-afff-4d65-9b75-010211368bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:51.495776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593281da-afff-4d65-9b75-010211368bee None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:51.496054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593281da-afff-4d65-9b75-010211368bee None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:51.496321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593281da-afff-4d65-9b75-010211368bee None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:51.497021 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593281da-afff-4d65-9b75-010211368bee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:51.497320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593281da-afff-4d65-9b75-010211368bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:51.498724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593281da-afff-4d65-9b75-010211368bee None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:51.507184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 343/700] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 00:12:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:52.169234 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63994-57f9-4b68-8e63-0526cbf49590 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:52.170316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63994-57f9-4b68-8e63-0526cbf49590 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:52.170836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63994-57f9-4b68-8e63-0526cbf49590 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:52.172719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 358/701] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:12:52.177973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61200b14-869f-43fc-b6b9-540da62b56f1 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:52.178811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61200b14-869f-43fc-b6b9-540da62b56f1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:52.179296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61200b14-869f-43fc-b6b9-540da62b56f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:52.196227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-61200b14-869f-43fc-b6b9-540da62b56f1 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:52.197686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-61200b14-869f-43fc-b6b9-540da62b56f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:52.265369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 344/702] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:52.290883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e63994-57f9-4b68-8e63-0526cbf49590 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:52.423949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e63994-57f9-4b68-8e63-0526cbf49590 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:52.465782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad630cc-a650-4c26-9dcb-7584832fb2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:52.466601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad630cc-a650-4c26-9dcb-7584832fb2bf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:52.466882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad630cc-a650-4c26-9dcb-7584832fb2bf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:52.467152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad630cc-a650-4c26-9dcb-7584832fb2bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:52.483513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad630cc-a650-4c26-9dcb-7584832fb2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:52.490321 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-bad630cc-a650-4c26-9dcb-7584832fb2bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:12:52.496710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 359/703] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:52.497980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61200b14-869f-43fc-b6b9-540da62b56f1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:52.631132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61200b14-869f-43fc-b6b9-540da62b56f1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:52.640185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960a6da-5af1-4dbd-aaef-245334a435ec None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:52.640784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960a6da-5af1-4dbd-aaef-245334a435ec None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:52.641256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960a6da-5af1-4dbd-aaef-245334a435ec None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:52.643826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 360/704] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:52.648675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a19ca-cb1e-4cc6-bce0-bddacee48382 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:52.649186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a19ca-cb1e-4cc6-bce0-bddacee48382 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:52.649656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a19ca-cb1e-4cc6-bce0-bddacee48382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:52.678649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d21f7-f300-47e0-9ae8-455d3e97f6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:52.679260 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d21f7-f300-47e0-9ae8-455d3e97f6e4 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:52.679562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d21f7-f300-47e0-9ae8-455d3e97f6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:52.679841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d21f7-f300-47e0-9ae8-455d3e97f6e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:52.680593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d21f7-f300-47e0-9ae8-455d3e97f6e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:52.680902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d21f7-f300-47e0-9ae8-455d3e97f6e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:52.682302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d21f7-f300-47e0-9ae8-455d3e97f6e4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:52.691143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 345/705] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:52.696605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d21f7-f300-47e0-9ae8-455d3e97f6e4 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:52.697108 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-293a19ca-cb1e-4cc6-bce0-bddacee48382 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:52.699050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-293a19ca-cb1e-4cc6-bce0-bddacee48382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:52.796627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d21f7-f300-47e0-9ae8-455d3e97f6e4 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:52.811592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 361/706] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:52.831938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fe88d-6c02-41ef-9ee8-a015db6cd8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:52.833082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fe88d-6c02-41ef-9ee8-a015db6cd8e1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:52.833570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fe88d-6c02-41ef-9ee8-a015db6cd8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:52.834047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fe88d-6c02-41ef-9ee8-a015db6cd8e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:52.845424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fe88d-6c02-41ef-9ee8-a015db6cd8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:52.846360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a19ca-cb1e-4cc6-bce0-bddacee48382 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:52.847338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fe88d-6c02-41ef-9ee8-a015db6cd8e1 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:52.864191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-b15fe88d-6c02-41ef-9ee8-a015db6cd8e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:52.866009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 346/707] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:52.872116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fe88d-6c02-41ef-9ee8-a015db6cd8e1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:52.973746 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fe88d-6c02-41ef-9ee8-a015db6cd8e1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:53.003822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a19ca-cb1e-4cc6-bce0-bddacee48382 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:53.009536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81415e3f-2c94-4a0a-b696-38603b634bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:53.010426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81415e3f-2c94-4a0a-b696-38603b634bf8 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.011426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81415e3f-2c94-4a0a-b696-38603b634bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.011864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81415e3f-2c94-4a0a-b696-38603b634bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.012729 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81415e3f-2c94-4a0a-b696-38603b634bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:53.013181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81415e3f-2c94-4a0a-b696-38603b634bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:53.014735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81415e3f-2c94-4a0a-b696-38603b634bf8 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:53.027056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 347/708] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:53.032464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81415e3f-2c94-4a0a-b696-38603b634bf8 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:53.050982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90c568-b45d-4968-9aa8-f8598d505a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:53.051797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c568-b45d-4968-9aa8-f8598d505a2b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.052076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c568-b45d-4968-9aa8-f8598d505a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.052344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c568-b45d-4968-9aa8-f8598d505a2b None admin] PATH_INFO: `/v3/services/network` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.052993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90c568-b45d-4968-9aa8-f8598d505a2b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:53.054365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e90c568-b45d-4968-9aa8-f8598d505a2b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:53.075828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-6e90c568-b45d-4968-9aa8-f8598d505a2b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 00:12:53.077419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 362/709] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:52 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:53.083923 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90c568-b45d-4968-9aa8-f8598d505a2b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:53.138737 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81415e3f-2c94-4a0a-b696-38603b634bf8 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:53.174582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07182ef-e1fa-4239-967c-89a0f4eedf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:53.175766 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07182ef-e1fa-4239-967c-89a0f4eedf26 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.176258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07182ef-e1fa-4239-967c-89a0f4eedf26 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.176733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07182ef-e1fa-4239-967c-89a0f4eedf26 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.184370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07182ef-e1fa-4239-967c-89a0f4eedf26 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:53.186543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07182ef-e1fa-4239-967c-89a0f4eedf26 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:53.191344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90c568-b45d-4968-9aa8-f8598d505a2b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:53.201143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-e07182ef-e1fa-4239-967c-89a0f4eedf26 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 00:12:53.202921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 348/710] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 00:12:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:53.208395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07182ef-e1fa-4239-967c-89a0f4eedf26 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:53.225856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a1f7-4fb5-444d-9224-53413a46c43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:53.226473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a1f7-4fb5-444d-9224-53413a46c43c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.226755 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a1f7-4fb5-444d-9224-53413a46c43c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.227029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a1f7-4fb5-444d-9224-53413a46c43c None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.227726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a1f7-4fb5-444d-9224-53413a46c43c None admin] RBAC: Adding query filter params (name=network) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:53.228234 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a1f7-4fb5-444d-9224-53413a46c43c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:53.230314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3a1f7-4fb5-444d-9224-53413a46c43c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:53.235246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 363/711] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:12:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:53.240402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a1f7-4fb5-444d-9224-53413a46c43c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:53.311640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07182ef-e1fa-4239-967c-89a0f4eedf26 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:53.340794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a1f7-4fb5-444d-9224-53413a46c43c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:53.347596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c17cf-bbbe-4430-b24b-af4bf64f073d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:53.348270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c17cf-bbbe-4430-b24b-af4bf64f073d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.348724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c17cf-bbbe-4430-b24b-af4bf64f073d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.349178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c17cf-bbbe-4430-b24b-af4bf64f073d None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.350158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c17cf-bbbe-4430-b24b-af4bf64f073d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:53.350632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c17cf-bbbe-4430-b24b-af4bf64f073d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:53.352199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c17cf-bbbe-4430-b24b-af4bf64f073d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:53.372158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 349/712] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 00:12:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:53.378069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c17cf-bbbe-4430-b24b-af4bf64f073d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:53.379890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14e868-7450-4d80-bdd1-0cf60e37d466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:53.380646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14e868-7450-4d80-bdd1-0cf60e37d466 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.380928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14e868-7450-4d80-bdd1-0cf60e37d466 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.381196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14e868-7450-4d80-bdd1-0cf60e37d466 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.381957 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14e868-7450-4d80-bdd1-0cf60e37d466 None admin] RBAC: Adding query filter params (type=network) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:53.382297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14e868-7450-4d80-bdd1-0cf60e37d466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:53.383675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14e868-7450-4d80-bdd1-0cf60e37d466 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:53.390758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 364/713] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:12:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:53.485369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c17cf-bbbe-4430-b24b-af4bf64f073d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:53.521047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773015-d2fb-422e-a1c7-8d1bedb90a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:53.521724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773015-d2fb-422e-a1c7-8d1bedb90a2a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.522010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773015-d2fb-422e-a1c7-8d1bedb90a2a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.522315 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34773015-d2fb-422e-a1c7-8d1bedb90a2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.596663 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773015-d2fb-422e-a1c7-8d1bedb90a2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:53.598147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34773015-d2fb-422e-a1c7-8d1bedb90a2a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:53.704674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bae5cc-0894-4ca9-80c4-0caa4d211b1e None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.705302 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bae5cc-0894-4ca9-80c4-0caa4d211b1e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.705855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bae5cc-0894-4ca9-80c4-0caa4d211b1e None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.710347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 365/714] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:53.711683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 350/715] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 12 00:12:53.714741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dab67-b80d-4e02-8ba9-e406a9e546b4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.715243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dab67-b80d-4e02-8ba9-e406a9e546b4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.715996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dab67-b80d-4e02-8ba9-e406a9e546b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.716500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773015-d2fb-422e-a1c7-8d1bedb90a2a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:53.736475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-270dab67-b80d-4e02-8ba9-e406a9e546b4 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:53.737959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-270dab67-b80d-4e02-8ba9-e406a9e546b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:53.814027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 366/716] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:53.822236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34773015-d2fb-422e-a1c7-8d1bedb90a2a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:53.834588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dab67-b80d-4e02-8ba9-e406a9e546b4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:53.857241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3eaf0-886b-4e87-91cb-983f4b12c19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:53.858355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3eaf0-886b-4e87-91cb-983f4b12c19f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:53.858787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3eaf0-886b-4e87-91cb-983f4b12c19f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:53.859207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3eaf0-886b-4e87-91cb-983f4b12c19f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:53.869441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3eaf0-886b-4e87-91cb-983f4b12c19f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:53.871155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3eaf0-886b-4e87-91cb-983f4b12c19f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:53.888656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-bcc3eaf0-886b-4e87-91cb-983f4b12c19f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:53.894538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 351/717] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:53.896115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3eaf0-886b-4e87-91cb-983f4b12c19f None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:53.979206 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dab67-b80d-4e02-8ba9-e406a9e546b4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.024442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8e4d-b3ba-4e5b-a164-1d78c4585309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.026034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8e4d-b3ba-4e5b-a164-1d78c4585309 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.027052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8e4d-b3ba-4e5b-a164-1d78c4585309 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.027480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8e4d-b3ba-4e5b-a164-1d78c4585309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.033730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3eaf0-886b-4e87-91cb-983f4b12c19f None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.040771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c8e4d-b3ba-4e5b-a164-1d78c4585309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:54.048509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-5e2c8e4d-b3ba-4e5b-a164-1d78c4585309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:12:54.054664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 367/718] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:12:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:54.056182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5880cc-013c-4a07-8116-be7d6c13561f None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.056669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5880cc-013c-4a07-8116-be7d6c13561f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.057168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5880cc-013c-4a07-8116-be7d6c13561f None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.063448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 368/719] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:54.064379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5880cc-013c-4a07-8116-be7d6c13561f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.071988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9585aa-7b2c-4a67-854a-9ddb674c0251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.072665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9585aa-7b2c-4a67-854a-9ddb674c0251 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.072953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9585aa-7b2c-4a67-854a-9ddb674c0251 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.073279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9585aa-7b2c-4a67-854a-9ddb674c0251 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.074168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9585aa-7b2c-4a67-854a-9ddb674c0251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:54.075066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9585aa-7b2c-4a67-854a-9ddb674c0251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:54.076945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9585aa-7b2c-4a67-854a-9ddb674c0251 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:54.092154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 352/720] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:54.098615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d9aaf-37de-4274-9979-407143015a26 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.099076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d9aaf-37de-4274-9979-407143015a26 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.099508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d9aaf-37de-4274-9979-407143015a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.124994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ef4d9aaf-37de-4274-9979-407143015a26 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:54.126601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ef4d9aaf-37de-4274-9979-407143015a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:54.171647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5880cc-013c-4a07-8116-be7d6c13561f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.207439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 353/721] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:54.208948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d9aaf-37de-4274-9979-407143015a26 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.210987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2c60e-e1bf-4dd2-bd2a-e38a2b912d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.211647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2c60e-e1bf-4dd2-bd2a-e38a2b912d33 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.211935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2c60e-e1bf-4dd2-bd2a-e38a2b912d33 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.212219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2c60e-e1bf-4dd2-bd2a-e38a2b912d33 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.218287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2c60e-e1bf-4dd2-bd2a-e38a2b912d33 None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:54.218287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2c60e-e1bf-4dd2-bd2a-e38a2b912d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:54.218287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2c60e-e1bf-4dd2-bd2a-e38a2b912d33 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:54.224406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 369/722] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:54.233446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2c60e-e1bf-4dd2-bd2a-e38a2b912d33 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.326668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d9aaf-37de-4274-9979-407143015a26 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.355186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2c60e-e1bf-4dd2-bd2a-e38a2b912d33 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.360517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31fd69-cf50-40cf-b9a5-9ba59010f07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.361305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31fd69-cf50-40cf-b9a5-9ba59010f07e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.361584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31fd69-cf50-40cf-b9a5-9ba59010f07e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.362080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31fd69-cf50-40cf-b9a5-9ba59010f07e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.368571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31fd69-cf50-40cf-b9a5-9ba59010f07e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:54.370522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31fd69-cf50-40cf-b9a5-9ba59010f07e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:54.383066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-ae31fd69-cf50-40cf-b9a5-9ba59010f07e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:54.386427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 354/723] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:54.386427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31fd69-cf50-40cf-b9a5-9ba59010f07e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.389364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b6c36-c7de-47ac-b3b4-299f4cd8362b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.390421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b6c36-c7de-47ac-b3b4-299f4cd8362b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.390715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b6c36-c7de-47ac-b3b4-299f4cd8362b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.390996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b6c36-c7de-47ac-b3b4-299f4cd8362b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.401561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b6c36-c7de-47ac-b3b4-299f4cd8362b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:54.403024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b6c36-c7de-47ac-b3b4-299f4cd8362b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:54.419065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-e90b6c36-c7de-47ac-b3b4-299f4cd8362b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:54.420255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 370/724] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:54.421508 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35439647-cd2a-43d2-ba43-9a495597e6c1 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.421794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35439647-cd2a-43d2-ba43-9a495597e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.422066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35439647-cd2a-43d2-ba43-9a495597e6c1 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.423315 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 371/725] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:54.424154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35439647-cd2a-43d2-ba43-9a495597e6c1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.491972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31fd69-cf50-40cf-b9a5-9ba59010f07e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.526283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10947-a407-444a-a0df-a2423b4f1966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.527320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10947-a407-444a-a0df-a2423b4f1966 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.527782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10947-a407-444a-a0df-a2423b4f1966 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.528205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e10947-a407-444a-a0df-a2423b4f1966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.528383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35439647-cd2a-43d2-ba43-9a495597e6c1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.541051 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e10947-a407-444a-a0df-a2423b4f1966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:54.550113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-f3e10947-a407-444a-a0df-a2423b4f1966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:12:54.552507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 355/726] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:54.553734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10947-a407-444a-a0df-a2423b4f1966 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.561129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663c8eb-0478-44f5-82b8-00e83d805c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.561799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c8eb-0478-44f5-82b8-00e83d805c25 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.562083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c8eb-0478-44f5-82b8-00e83d805c25 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.562401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663c8eb-0478-44f5-82b8-00e83d805c25 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.563349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c8eb-0478-44f5-82b8-00e83d805c25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:54.563663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c8eb-0478-44f5-82b8-00e83d805c25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:54.565127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f663c8eb-0478-44f5-82b8-00e83d805c25 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:54.576942 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 372/727] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:54.578419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd180-cad6-4317-997c-2847d6f861a3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.578857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd180-cad6-4317-997c-2847d6f861a3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.579298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd180-cad6-4317-997c-2847d6f861a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.595346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ec7fd180-cad6-4317-997c-2847d6f861a3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:54.596515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ec7fd180-cad6-4317-997c-2847d6f861a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:54.659149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e10947-a407-444a-a0df-a2423b4f1966 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.664887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 373/728] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:54.666010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd180-cad6-4317-997c-2847d6f861a3 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.701334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9b360-60dd-4c8d-85c2-3b188d8ce9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.702004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9b360-60dd-4c8d-85c2-3b188d8ce9fb None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.702318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9b360-60dd-4c8d-85c2-3b188d8ce9fb None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.702602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9b360-60dd-4c8d-85c2-3b188d8ce9fb None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.703324 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9b360-60dd-4c8d-85c2-3b188d8ce9fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:54.703632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9b360-60dd-4c8d-85c2-3b188d8ce9fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:54.704999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9b360-60dd-4c8d-85c2-3b188d8ce9fb None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:54.721631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 356/729] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:54.721631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9b360-60dd-4c8d-85c2-3b188d8ce9fb None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.772040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd180-cad6-4317-997c-2847d6f861a3 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.806927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e86c3-ab35-43ac-b47f-1bc0d4a7867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.808226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e86c3-ab35-43ac-b47f-1bc0d4a7867f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.808512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e86c3-ab35-43ac-b47f-1bc0d4a7867f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.808783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e86c3-ab35-43ac-b47f-1bc0d4a7867f None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.809523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e86c3-ab35-43ac-b47f-1bc0d4a7867f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:54.809832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e86c3-ab35-43ac-b47f-1bc0d4a7867f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:54.811236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e86c3-ab35-43ac-b47f-1bc0d4a7867f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:54.819114 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 374/730] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:54.820090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e86c3-ab35-43ac-b47f-1bc0d4a7867f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.827166 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9b360-60dd-4c8d-85c2-3b188d8ce9fb None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.861966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f645622-58fb-4d81-9466-af7c589845f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.862923 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f645622-58fb-4d81-9466-af7c589845f6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.863353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f645622-58fb-4d81-9466-af7c589845f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.863773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f645622-58fb-4d81-9466-af7c589845f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.864737 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f645622-58fb-4d81-9466-af7c589845f6 None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=ecf0479293de4edfbf2815c1e9f2f7cc) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:54.865189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f645622-58fb-4d81-9466-af7c589845f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:54.866788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f645622-58fb-4d81-9466-af7c589845f6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:54.882461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 357/731] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/role_assignments?user.id=ecf0479293de4edfbf2815c1e9f2f7cc&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=f0208c43117c4b799194c83781a46e09 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:54.883645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f645622-58fb-4d81-9466-af7c589845f6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:54.933134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e86c3-ab35-43ac-b47f-1bc0d4a7867f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:54.969351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f5286-e384-452d-94aa-e1a503bbec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:54.970422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f5286-e384-452d-94aa-e1a503bbec98 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:54.970907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f5286-e384-452d-94aa-e1a503bbec98 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:54.971330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f5286-e384-452d-94aa-e1a503bbec98 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:54.972213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f5286-e384-452d-94aa-e1a503bbec98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:54.973756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f5286-e384-452d-94aa-e1a503bbec98 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:54.991768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 375/732] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:12:54 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:54.993101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f5286-e384-452d-94aa-e1a503bbec98 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:55.042604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f645622-58fb-4d81-9466-af7c589845f6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:55.112709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f5286-e384-452d-94aa-e1a503bbec98 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:55.114154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2151664-02d7-4aa1-85e2-79b579b17600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:55.115201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2151664-02d7-4aa1-85e2-79b579b17600 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:55.115313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2151664-02d7-4aa1-85e2-79b579b17600 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:55.115584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2151664-02d7-4aa1-85e2-79b579b17600 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:55.124448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2151664-02d7-4aa1-85e2-79b579b17600 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:55.132392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2151664-02d7-4aa1-85e2-79b579b17600 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:55.152272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83e6c-81ee-48f7-898f-f2fa394d7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:55.153486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83e6c-81ee-48f7-898f-f2fa394d7b82 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:55.154019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83e6c-81ee-48f7-898f-f2fa394d7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:55.154142 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-a2151664-02d7-4aa1-85e2-79b579b17600 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 00:12:55.154661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a83e6c-81ee-48f7-898f-f2fa394d7b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:55.159854 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 358/733] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:55.161472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2151664-02d7-4aa1-85e2-79b579b17600 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:55.172501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a83e6c-81ee-48f7-898f-f2fa394d7b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:55.174400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a83e6c-81ee-48f7-898f-f2fa394d7b82 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:55.212797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-81a83e6c-81ee-48f7-898f-f2fa394d7b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:55.217688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 376/734] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:55.221980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83e6c-81ee-48f7-898f-f2fa394d7b82 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:55.333674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2151664-02d7-4aa1-85e2-79b579b17600 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:55.357954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a83e6c-81ee-48f7-898f-f2fa394d7b82 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:55.371010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcc087-8110-421d-8cdd-33219b7f6bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:55.371621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcc087-8110-421d-8cdd-33219b7f6bca None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:55.371905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcc087-8110-421d-8cdd-33219b7f6bca None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:55.372182 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcc087-8110-421d-8cdd-33219b7f6bca None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:55.373017 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcc087-8110-421d-8cdd-33219b7f6bca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:55.373323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcc087-8110-421d-8cdd-33219b7f6bca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:55.374780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcc087-8110-421d-8cdd-33219b7f6bca None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:55.394290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 359/735] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 00:12:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:55.396781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a3529-e92b-4984-854a-879f310f1405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:55.397457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a3529-e92b-4984-854a-879f310f1405 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:55.397740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a3529-e92b-4984-854a-879f310f1405 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:55.398016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a3529-e92b-4984-854a-879f310f1405 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:55.398788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a3529-e92b-4984-854a-879f310f1405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:55.399092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a3529-e92b-4984-854a-879f310f1405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:55.399409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcc087-8110-421d-8cdd-33219b7f6bca None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:55.400685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a3529-e92b-4984-854a-879f310f1405 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:55.416550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 377/736] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:55.422966 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a3529-e92b-4984-854a-879f310f1405 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:55.527708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcc087-8110-421d-8cdd-33219b7f6bca None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:55.537901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a3529-e92b-4984-854a-879f310f1405 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:55.594401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab4fad-7795-414a-88c1-83cce68f57ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:55.595080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab4fad-7795-414a-88c1-83cce68f57ba None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:55.595365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab4fad-7795-414a-88c1-83cce68f57ba None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:55.595644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab4fad-7795-414a-88c1-83cce68f57ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:55.608855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb4b7e-3bb3-485e-8a96-0e35345e6f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:55.609673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4b7e-3bb3-485e-8a96-0e35345e6f26 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:55.609955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4b7e-3bb3-485e-8a96-0e35345e6f26 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:55.610232 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb4b7e-3bb3-485e-8a96-0e35345e6f26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:55.623034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb4b7e-3bb3-485e-8a96-0e35345e6f26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:55.624401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bb4b7e-3bb3-485e-8a96-0e35345e6f26 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:55.644412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-87bb4b7e-3bb3-485e-8a96-0e35345e6f26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 00:12:55.645635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 378/737] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:55.657147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb4b7e-3bb3-485e-8a96-0e35345e6f26 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:55.731956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab4fad-7795-414a-88c1-83cce68f57ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:55.733451 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab4fad-7795-414a-88c1-83cce68f57ba None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:55.829048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb4b7e-3bb3-485e-8a96-0e35345e6f26 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:55.887463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213de4d-af2e-49d4-87d7-718c13f1e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:55.888131 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213de4d-af2e-49d4-87d7-718c13f1e52b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:55.888418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213de4d-af2e-49d4-87d7-718c13f1e52b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:55.888699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213de4d-af2e-49d4-87d7-718c13f1e52b None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:55.889541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213de4d-af2e-49d4-87d7-718c13f1e52b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:55.889850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213de4d-af2e-49d4-87d7-718c13f1e52b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:55.891305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213de4d-af2e-49d4-87d7-718c13f1e52b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:55.899054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 360/738] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:55.907018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab4fad-7795-414a-88c1-83cce68f57ba None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:55.928274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 379/739] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 00:12:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:55.937923 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213de4d-af2e-49d4-87d7-718c13f1e52b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:56.065836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab4fad-7795-414a-88c1-83cce68f57ba None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:56.077776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213de4d-af2e-49d4-87d7-718c13f1e52b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:56.108901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46b6b9-171c-49bf-960f-4beebe77a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:56.110214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46b6b9-171c-49bf-960f-4beebe77a00f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.110903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46b6b9-171c-49bf-960f-4beebe77a00f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.111712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46b6b9-171c-49bf-960f-4beebe77a00f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.119178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0d0ce-71aa-406e-ae43-b25d22a447d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:56.119835 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d0ce-71aa-406e-ae43-b25d22a447d6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.120678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d0ce-71aa-406e-ae43-b25d22a447d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.120960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d0ce-71aa-406e-ae43-b25d22a447d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.126091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46b6b9-171c-49bf-960f-4beebe77a00f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:56.127842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46b6b9-171c-49bf-960f-4beebe77a00f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:56.149083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-0b46b6b9-171c-49bf-960f-4beebe77a00f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:56.151141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 361/740] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:56.155587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60583d6-f255-4bdf-b8fa-11d23998763b None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.155587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60583d6-f255-4bdf-b8fa-11d23998763b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.155587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60583d6-f255-4bdf-b8fa-11d23998763b None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.158320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 362/741] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:56.159485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60583d6-f255-4bdf-b8fa-11d23998763b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:56.206994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0d0ce-71aa-406e-ae43-b25d22a447d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:56.209213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0d0ce-71aa-406e-ae43-b25d22a447d6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:56.265852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60583d6-f255-4bdf-b8fa-11d23998763b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:56.299831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3512a6-ae20-4113-9865-d9b297a4ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:56.300900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3512a6-ae20-4113-9865-d9b297a4ad6a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.301378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3512a6-ae20-4113-9865-d9b297a4ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.301846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3512a6-ae20-4113-9865-d9b297a4ad6a None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.302990 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3512a6-ae20-4113-9865-d9b297a4ad6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:56.303559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3512a6-ae20-4113-9865-d9b297a4ad6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:56.305167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3512a6-ae20-4113-9865-d9b297a4ad6a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:56.322640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 363/742] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:56.324750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f2ba5-3319-4626-9d63-b152aa1feffa None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.325236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f2ba5-3319-4626-9d63-b152aa1feffa None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.325706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f2ba5-3319-4626-9d63-b152aa1feffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.329187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 380/743] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:12:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 12 00:12:56.330019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0d0ce-71aa-406e-ae43-b25d22a447d6 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:56.343967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-dc3f2ba5-3319-4626-9d63-b152aa1feffa None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:56.345724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-dc3f2ba5-3319-4626-9d63-b152aa1feffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:56.430502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 364/744] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 12 00:12:56.431397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f2ba5-3319-4626-9d63-b152aa1feffa None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:56.434296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0d0ce-71aa-406e-ae43-b25d22a447d6 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:56.468509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a85045-316c-4691-97aa-7625b0c12733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:56.469337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a85045-316c-4691-97aa-7625b0c12733 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.469599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a85045-316c-4691-97aa-7625b0c12733 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.469876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a85045-316c-4691-97aa-7625b0c12733 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.476910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a85045-316c-4691-97aa-7625b0c12733 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:56.478449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a85045-316c-4691-97aa-7625b0c12733 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:56.491933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-77a85045-316c-4691-97aa-7625b0c12733 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:56.493137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 381/745] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:56.493882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a85045-316c-4691-97aa-7625b0c12733 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:56.549118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f2ba5-3319-4626-9d63-b152aa1feffa None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:56.584024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934c011-fc7b-4dfc-9ea1-4c94db064dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:56.584872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934c011-fc7b-4dfc-9ea1-4c94db064dcb None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.585158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934c011-fc7b-4dfc-9ea1-4c94db064dcb None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.585429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934c011-fc7b-4dfc-9ea1-4c94db064dcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.595500 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a85045-316c-4691-97aa-7625b0c12733 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:56.596111 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934c011-fc7b-4dfc-9ea1-4c94db064dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:56.597573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934c011-fc7b-4dfc-9ea1-4c94db064dcb None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:56.614400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-2934c011-fc7b-4dfc-9ea1-4c94db064dcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:56.615922 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 365/746] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:56.616707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934c011-fc7b-4dfc-9ea1-4c94db064dcb None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:56.629766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c8253-a239-44d6-8bd9-e5f9faf82422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:56.630481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c8253-a239-44d6-8bd9-e5f9faf82422 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.630776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c8253-a239-44d6-8bd9-e5f9faf82422 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.631056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c8253-a239-44d6-8bd9-e5f9faf82422 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.631774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c8253-a239-44d6-8bd9-e5f9faf82422 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:56.633134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c8253-a239-44d6-8bd9-e5f9faf82422 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:56.650827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 382/747] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:12:56 2022] POST /identity/v3/services => generated 240 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:12:56.653650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c8253-a239-44d6-8bd9-e5f9faf82422 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:56.739636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934c011-fc7b-4dfc-9ea1-4c94db064dcb None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:56.813986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a56ff-9614-427a-bb24-60d4fe732b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:56.814860 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a56ff-9614-427a-bb24-60d4fe732b7e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.815147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a56ff-9614-427a-bb24-60d4fe732b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.815426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a56ff-9614-427a-bb24-60d4fe732b7e None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.816331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a56ff-9614-427a-bb24-60d4fe732b7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:56.816645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a56ff-9614-427a-bb24-60d4fe732b7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:56.818099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a56ff-9614-427a-bb24-60d4fe732b7e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:56.820260 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c8253-a239-44d6-8bd9-e5f9faf82422 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:56.844050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 366/748] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:56.850040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a56ff-9614-427a-bb24-60d4fe732b7e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:56.892010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59b650-9a52-480f-adb8-9ce70d28a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:56.892786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59b650-9a52-480f-adb8-9ce70d28a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:56.893078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59b650-9a52-480f-adb8-9ce70d28a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:56.893359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59b650-9a52-480f-adb8-9ce70d28a4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:56.894092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59b650-9a52-480f-adb8-9ce70d28a4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:56.894430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59b650-9a52-480f-adb8-9ce70d28a4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:56.895821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59b650-9a52-480f-adb8-9ce70d28a4b5 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:56.908157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 383/749] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:56.914292 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59b650-9a52-480f-adb8-9ce70d28a4b5 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:56.978520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a56ff-9614-427a-bb24-60d4fe732b7e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:57.012038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948541-3dc6-4e75-afdb-da748c0b0e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:57.012914 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948541-3dc6-4e75-afdb-da748c0b0e5c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:57.013355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948541-3dc6-4e75-afdb-da748c0b0e5c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:57.013780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948541-3dc6-4e75-afdb-da748c0b0e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:57.014778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9948541-3dc6-4e75-afdb-da748c0b0e5c None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=085b8de5c190423bb7ba5da5993479f0) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:57.015230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9948541-3dc6-4e75-afdb-da748c0b0e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:57.016791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9948541-3dc6-4e75-afdb-da748c0b0e5c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:57.021670 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59b650-9a52-480f-adb8-9ce70d28a4b5 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:57.023186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 367/750] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:56 2022] GET /identity/v3/role_assignments?user.id=085b8de5c190423bb7ba5da5993479f0&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:57.068547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94a234-4535-4690-ba6b-f2f6d1695efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:57.069377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a234-4535-4690-ba6b-f2f6d1695efe None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:57.069665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a234-4535-4690-ba6b-f2f6d1695efe None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:57.069944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94a234-4535-4690-ba6b-f2f6d1695efe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:57.078141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94a234-4535-4690-ba6b-f2f6d1695efe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:57.079647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94a234-4535-4690-ba6b-f2f6d1695efe None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:57.094457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-4f94a234-4535-4690-ba6b-f2f6d1695efe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:57.096099 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 384/751] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:57.101769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948541-3dc6-4e75-afdb-da748c0b0e5c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:57.221299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948541-3dc6-4e75-afdb-da748c0b0e5c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:57.256450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0908b5-8393-463e-89c7-501a0b5602e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:57.257459 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0908b5-8393-463e-89c7-501a0b5602e3 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:57.257927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0908b5-8393-463e-89c7-501a0b5602e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:57.258439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0908b5-8393-463e-89c7-501a0b5602e3 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:57.259417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0908b5-8393-463e-89c7-501a0b5602e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:57.259965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0908b5-8393-463e-89c7-501a0b5602e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:57.261677 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0908b5-8393-463e-89c7-501a0b5602e3 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:57.274937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 368/752] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:12:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:57.283384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94a234-4535-4690-ba6b-f2f6d1695efe None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:57.385824 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18941bf-1ae3-418b-98e3-1e42a624a2df None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:57.386703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18941bf-1ae3-418b-98e3-1e42a624a2df None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:57.387133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18941bf-1ae3-418b-98e3-1e42a624a2df None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:57.388643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 369/753] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:57.393938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892d5f-9104-4384-aa02-ab3743499517 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:57.394228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892d5f-9104-4384-aa02-ab3743499517 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:57.394560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892d5f-9104-4384-aa02-ab3743499517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:57.396877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94a234-4535-4690-ba6b-f2f6d1695efe None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:57.431931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0262af8-72da-4fbd-b751-f4f104c626ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:57.433394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0262af8-72da-4fbd-b751-f4f104c626ef None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:57.433828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0262af8-72da-4fbd-b751-f4f104c626ef None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:57.434280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0262af8-72da-4fbd-b751-f4f104c626ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:57.435376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-de892d5f-9104-4384-aa02-ab3743499517 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:57.435625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0262af8-72da-4fbd-b751-f4f104c626ef None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=dc91dcec14694193a8e60e32fc138b8f) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:57.436098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0262af8-72da-4fbd-b751-f4f104c626ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:57.436575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-de892d5f-9104-4384-aa02-ab3743499517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:57.437832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0262af8-72da-4fbd-b751-f4f104c626ef None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:57.444155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 385/754] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:12:57 2022] GET /identity/v3/role_assignments?user.id=dc91dcec14694193a8e60e32fc138b8f&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=f0208c43117c4b799194c83781a46e09 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:57.545967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 370/755] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:12:57.568001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0262af8-72da-4fbd-b751-f4f104c626ef None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:57.725090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0262af8-72da-4fbd-b751-f4f104c626ef None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:57.776249 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3cdf9-4dfc-4ad8-ba3f-e20349fc02a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:57.777501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3cdf9-4dfc-4ad8-ba3f-e20349fc02a5 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:57.777783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3cdf9-4dfc-4ad8-ba3f-e20349fc02a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:57.778058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3cdf9-4dfc-4ad8-ba3f-e20349fc02a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:57.795098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3cdf9-4dfc-4ad8-ba3f-e20349fc02a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:12:57.803506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-ade3cdf9-4dfc-4ad8-ba3f-e20349fc02a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:12:57.806174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 386/756] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:12:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:57.811831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de892d5f-9104-4384-aa02-ab3743499517 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:57.949220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de892d5f-9104-4384-aa02-ab3743499517 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:58.007852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ebd14-adb2-46f9-bf92-92af82b1b33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:58.008533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ebd14-adb2-46f9-bf92-92af82b1b33c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:58.008812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ebd14-adb2-46f9-bf92-92af82b1b33c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:58.009270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ebd14-adb2-46f9-bf92-92af82b1b33c None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:58.010032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ebd14-adb2-46f9-bf92-92af82b1b33c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:58.010354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ebd14-adb2-46f9-bf92-92af82b1b33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:58.011818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ebd14-adb2-46f9-bf92-92af82b1b33c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:58.017660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bb5c4-62e1-4887-97ae-3e30da635504 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:58.017953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bb5c4-62e1-4887-97ae-3e30da635504 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:58.018236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bb5c4-62e1-4887-97ae-3e30da635504 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:58.022346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 387/757] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:58.023498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 371/758] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:12:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:58.028812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eddf46-7349-48d9-85dc-723103d445b8 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:58.029102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eddf46-7349-48d9-85dc-723103d445b8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:58.029520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eddf46-7349-48d9-85dc-723103d445b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:58.030394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ebd14-adb2-46f9-bf92-92af82b1b33c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:58.046183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-24eddf46-7349-48d9-85dc-723103d445b8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:58.047445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-24eddf46-7349-48d9-85dc-723103d445b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:58.160148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 388/759] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:12:58.193705 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ebd14-adb2-46f9-bf92-92af82b1b33c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:58.196356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eddf46-7349-48d9-85dc-723103d445b8 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:58.267821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87510e9-4cad-4f72-8a18-6314fc93539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:58.268648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87510e9-4cad-4f72-8a18-6314fc93539b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:58.268929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87510e9-4cad-4f72-8a18-6314fc93539b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:58.269203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87510e9-4cad-4f72-8a18-6314fc93539b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:58.288988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87510e9-4cad-4f72-8a18-6314fc93539b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:58.291462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87510e9-4cad-4f72-8a18-6314fc93539b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:58.319473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-e87510e9-4cad-4f72-8a18-6314fc93539b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:58.322154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 372/760] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:58.333849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87510e9-4cad-4f72-8a18-6314fc93539b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:58.365769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eddf46-7349-48d9-85dc-723103d445b8 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:58.402506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5aeda-ea11-4fba-9a71-8dd6e00b5b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:58.403313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5aeda-ea11-4fba-9a71-8dd6e00b5b7b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:58.403601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5aeda-ea11-4fba-9a71-8dd6e00b5b7b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:58.403887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5aeda-ea11-4fba-9a71-8dd6e00b5b7b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:58.404530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5aeda-ea11-4fba-9a71-8dd6e00b5b7b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:58.405955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5aeda-ea11-4fba-9a71-8dd6e00b5b7b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:58.420117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-7ee5aeda-ea11-4fba-9a71-8dd6e00b5b7b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 00:12:58.421582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 389/761] 10.222.0.32 () {56 vars in 1129 bytes} [Tue Apr 12 00:12:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:58.431473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5aeda-ea11-4fba-9a71-8dd6e00b5b7b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:58.485485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87510e9-4cad-4f72-8a18-6314fc93539b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:58.535141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440d48c-fa21-4481-b77d-fecc8946141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:58.535815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440d48c-fa21-4481-b77d-fecc8946141e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:58.536091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440d48c-fa21-4481-b77d-fecc8946141e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:58.536359 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440d48c-fa21-4481-b77d-fecc8946141e None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:58.537080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440d48c-fa21-4481-b77d-fecc8946141e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:58.537381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440d48c-fa21-4481-b77d-fecc8946141e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:58.539965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440d48c-fa21-4481-b77d-fecc8946141e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:58.561056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 373/762] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:58.564586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440d48c-fa21-4481-b77d-fecc8946141e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:58.625147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5aeda-ea11-4fba-9a71-8dd6e00b5b7b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:58.702647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a16167-91ea-4eb5-bc93-f4baf5a04e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:58.703326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a16167-91ea-4eb5-bc93-f4baf5a04e99 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:58.703610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a16167-91ea-4eb5-bc93-f4baf5a04e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:58.703886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a16167-91ea-4eb5-bc93-f4baf5a04e99 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:58.704592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a16167-91ea-4eb5-bc93-f4baf5a04e99 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:58.704894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a16167-91ea-4eb5-bc93-f4baf5a04e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:58.706279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a16167-91ea-4eb5-bc93-f4baf5a04e99 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:58.720176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 390/763] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 00:12:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:58.725379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a16167-91ea-4eb5-bc93-f4baf5a04e99 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:58.742736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440d48c-fa21-4481-b77d-fecc8946141e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:58.779343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e78dc-43f2-4835-8881-fe2283f8b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:58.780144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e78dc-43f2-4835-8881-fe2283f8b5dd None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:58.780425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e78dc-43f2-4835-8881-fe2283f8b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:58.780702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e78dc-43f2-4835-8881-fe2283f8b5dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:58.798302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e78dc-43f2-4835-8881-fe2283f8b5dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:58.799748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e78dc-43f2-4835-8881-fe2283f8b5dd None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:58.820118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-762e78dc-43f2-4835-8881-fe2283f8b5dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 00:12:58.821690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 374/764] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 00:12:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:58.828910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e78dc-43f2-4835-8881-fe2283f8b5dd None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:58.888408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a16167-91ea-4eb5-bc93-f4baf5a04e99 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:58.933097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f978e80-77c4-47db-a77c-1a3ece29f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:58.933775 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f978e80-77c4-47db-a77c-1a3ece29f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:58.934058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f978e80-77c4-47db-a77c-1a3ece29f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:58.934353 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f978e80-77c4-47db-a77c-1a3ece29f9c2 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:58.935063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f978e80-77c4-47db-a77c-1a3ece29f9c2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:58.935365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f978e80-77c4-47db-a77c-1a3ece29f9c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:58.936721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f978e80-77c4-47db-a77c-1a3ece29f9c2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:58.945658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 391/765] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 00:12:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:12:58.951663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f978e80-77c4-47db-a77c-1a3ece29f9c2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:59.041181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e78dc-43f2-4835-8881-fe2283f8b5dd None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:59.103835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b6e67-e969-4267-bcb9-a8e4853254ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:59.105080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b6e67-e969-4267-bcb9-a8e4853254ea None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.105359 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b6e67-e969-4267-bcb9-a8e4853254ea None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.105629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72b6e67-e969-4267-bcb9-a8e4853254ea None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.106490 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b6e67-e969-4267-bcb9-a8e4853254ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:59.106798 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b6e67-e969-4267-bcb9-a8e4853254ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:59.108226 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72b6e67-e969-4267-bcb9-a8e4853254ea None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:59.134419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 375/766] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 00:12:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:59.137205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f978e80-77c4-47db-a77c-1a3ece29f9c2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:59.139723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b6e67-e969-4267-bcb9-a8e4853254ea None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:59.204732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de274e-b9e7-41bc-a8bf-b4268601b06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:59.205792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de274e-b9e7-41bc-a8bf-b4268601b06e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.206319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de274e-b9e7-41bc-a8bf-b4268601b06e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.206798 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de274e-b9e7-41bc-a8bf-b4268601b06e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.207814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de274e-b9e7-41bc-a8bf-b4268601b06e None admin] RBAC: Adding query filter params (interface=public, service_id=f9d3c6a0e01c40faa9a98d3a490f5133, region_id=RegionOne) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:59.208330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de274e-b9e7-41bc-a8bf-b4268601b06e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:59.209922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de274e-b9e7-41bc-a8bf-b4268601b06e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:59.222929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 392/767] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 00:12:58 2022] GET /identity/v3/endpoints?service_id=f9d3c6a0e01c40faa9a98d3a490f5133&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:59.228213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de274e-b9e7-41bc-a8bf-b4268601b06e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:59.306804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72b6e67-e969-4267-bcb9-a8e4853254ea None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:59.373155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de274e-b9e7-41bc-a8bf-b4268601b06e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:59.389903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220963d-39a9-45c6-93f3-dc5650eb37e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:59.390765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220963d-39a9-45c6-93f3-dc5650eb37e1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.391046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220963d-39a9-45c6-93f3-dc5650eb37e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.391320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220963d-39a9-45c6-93f3-dc5650eb37e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.411880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c727-d79f-45d1-9a9a-d79861e5cd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:59.412563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c727-d79f-45d1-9a9a-d79861e5cd59 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.412843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c727-d79f-45d1-9a9a-d79861e5cd59 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.413112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c727-d79f-45d1-9a9a-d79861e5cd59 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.414060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6c727-d79f-45d1-9a9a-d79861e5cd59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:59.415415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220963d-39a9-45c6-93f3-dc5650eb37e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:59.415629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6c727-d79f-45d1-9a9a-d79861e5cd59 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:59.417418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220963d-39a9-45c6-93f3-dc5650eb37e1 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:59.422161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 393/768] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 00:12:59 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:59.450578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-a220963d-39a9-45c6-93f3-dc5650eb37e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:12:59.452162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 376/769] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:59.457509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c727-d79f-45d1-9a9a-d79861e5cd59 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:59.576091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9f19-b0e7-4df7-9a46-ce0a750cabea None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.576590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9f19-b0e7-4df7-9a46-ce0a750cabea None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.576590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce9f19-b0e7-4df7-9a46-ce0a750cabea None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.579434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 377/770] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:12:59.583825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4833f8d-0ae8-42dd-96f4-7ddf76092b70 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.584113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4833f8d-0ae8-42dd-96f4-7ddf76092b70 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.584395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4833f8d-0ae8-42dd-96f4-7ddf76092b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.602183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e4833f8d-0ae8-42dd-96f4-7ddf76092b70 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:59.603563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e4833f8d-0ae8-42dd-96f4-7ddf76092b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:59.668886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c727-d79f-45d1-9a9a-d79861e5cd59 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:59.691479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 378/771] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:12:59.709030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791939-ce92-423a-8e6d-eae12c2bb3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:59.709752 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791939-ce92-423a-8e6d-eae12c2bb3da None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.710040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791939-ce92-423a-8e6d-eae12c2bb3da None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.710341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a791939-ce92-423a-8e6d-eae12c2bb3da None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.711062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a791939-ce92-423a-8e6d-eae12c2bb3da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:12:59.711367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a791939-ce92-423a-8e6d-eae12c2bb3da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:59.712729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a791939-ce92-423a-8e6d-eae12c2bb3da None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:59.717592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4833f8d-0ae8-42dd-96f4-7ddf76092b70 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:59.728238 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 394/772] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:12:59.733320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791939-ce92-423a-8e6d-eae12c2bb3da None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:59.837048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4833f8d-0ae8-42dd-96f4-7ddf76092b70 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:59.851969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a791939-ce92-423a-8e6d-eae12c2bb3da None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:59.872152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35fc3-bfea-4672-bf40-5f53f9a09df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:59.872982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35fc3-bfea-4672-bf40-5f53f9a09df5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.873264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35fc3-bfea-4672-bf40-5f53f9a09df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.873540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35fc3-bfea-4672-bf40-5f53f9a09df5 None admin] PATH_INFO: `/v3/services/network` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.874218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35fc3-bfea-4672-bf40-5f53f9a09df5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:59.875726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35fc3-bfea-4672-bf40-5f53f9a09df5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:59.888816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-64e35fc3-bfea-4672-bf40-5f53f9a09df5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 00:12:59.889421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab8dfb-7a45-44df-b70a-17735ea43728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:59.890233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab8dfb-7a45-44df-b70a-17735ea43728 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.890471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 379/773] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:59 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:12:59.890592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab8dfb-7a45-44df-b70a-17735ea43728 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.890808 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab8dfb-7a45-44df-b70a-17735ea43728 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.892082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8824b1-9336-4af5-a6d0-99db7cfcae93 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.892375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8824b1-9336-4af5-a6d0-99db7cfcae93 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.892656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8824b1-9336-4af5-a6d0-99db7cfcae93 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.898119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 380/774] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:12:59.898278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab8dfb-7a45-44df-b70a-17735ea43728 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:59.898946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8824b1-9336-4af5-a6d0-99db7cfcae93 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:59.899681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab8dfb-7a45-44df-b70a-17735ea43728 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:59.914335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-b5ab8dfb-7a45-44df-b70a-17735ea43728 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:12:59.915822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 395/775] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:12:59.917103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f46b4-8c12-454e-84fa-f87fbb7501ca None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:59.917389 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f46b4-8c12-454e-84fa-f87fbb7501ca None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:59.917667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f46b4-8c12-454e-84fa-f87fbb7501ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:59.938952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-707f46b4-8c12-454e-84fa-f87fbb7501ca None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:59.940137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-707f46b4-8c12-454e-84fa-f87fbb7501ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:00.002261 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8824b1-9336-4af5-a6d0-99db7cfcae93 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.007697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 396/776] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:12:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:00.008551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f46b4-8c12-454e-84fa-f87fbb7501ca None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.056012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8776e9-c20a-4aca-8be3-2031d981294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.056686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8776e9-c20a-4aca-8be3-2031d981294f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.056973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8776e9-c20a-4aca-8be3-2031d981294f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.057269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8776e9-c20a-4aca-8be3-2031d981294f None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.057977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8776e9-c20a-4aca-8be3-2031d981294f None admin] RBAC: Adding query filter params (name=network) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:00.061453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8776e9-c20a-4aca-8be3-2031d981294f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:00.062893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8776e9-c20a-4aca-8be3-2031d981294f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:00.068107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 381/777] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:12:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:00.075029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8776e9-c20a-4aca-8be3-2031d981294f None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.107193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f46b4-8c12-454e-84fa-f87fbb7501ca None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.142906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53b08-0344-444b-ab31-a9c8a1870861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.143673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53b08-0344-444b-ab31-a9c8a1870861 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.144032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53b08-0344-444b-ab31-a9c8a1870861 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.144382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d53b08-0344-444b-ab31-a9c8a1870861 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.145243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d53b08-0344-444b-ab31-a9c8a1870861 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:00.145646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d53b08-0344-444b-ab31-a9c8a1870861 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:00.147609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d53b08-0344-444b-ab31-a9c8a1870861 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:00.163254 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 397/778] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:00.164721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53b08-0344-444b-ab31-a9c8a1870861 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.200741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8776e9-c20a-4aca-8be3-2031d981294f None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.235368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151103ef-c69d-4217-8d9d-99a342b701e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.236494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151103ef-c69d-4217-8d9d-99a342b701e2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.236955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151103ef-c69d-4217-8d9d-99a342b701e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.237449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151103ef-c69d-4217-8d9d-99a342b701e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.248298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151103ef-c69d-4217-8d9d-99a342b701e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:00.255549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-151103ef-c69d-4217-8d9d-99a342b701e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:13:00.256948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 382/779] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:00.257910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151103ef-c69d-4217-8d9d-99a342b701e2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.280969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d53b08-0344-444b-ab31-a9c8a1870861 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.314650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b7def-8086-4b09-9d2b-b09070c8fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.315326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b7def-8086-4b09-9d2b-b09070c8fad2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.315612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b7def-8086-4b09-9d2b-b09070c8fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.315893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b7def-8086-4b09-9d2b-b09070c8fad2 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.316594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b7def-8086-4b09-9d2b-b09070c8fad2 None admin] RBAC: Adding query filter params (type=network) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:00.316902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b7def-8086-4b09-9d2b-b09070c8fad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:00.318283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b7def-8086-4b09-9d2b-b09070c8fad2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:00.328083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 398/780] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:00.328083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69296bd6-e611-4514-a02e-e050f0c323c9 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.328083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69296bd6-e611-4514-a02e-e050f0c323c9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.328083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69296bd6-e611-4514-a02e-e050f0c323c9 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.328083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 399/781] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:00.328083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69296bd6-e611-4514-a02e-e050f0c323c9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.360554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151103ef-c69d-4217-8d9d-99a342b701e2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.393572 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca40c43-deb7-477e-905e-9b426b4bdee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.394521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40c43-deb7-477e-905e-9b426b4bdee0 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.394806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40c43-deb7-477e-905e-9b426b4bdee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.395080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca40c43-deb7-477e-905e-9b426b4bdee0 None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/ecf0479293de4edfbf2815c1e9f2f7cc/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.397072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca40c43-deb7-477e-905e-9b426b4bdee0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=ecf0479293de4edfbf2815c1e9f2f7cc, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:00.398535 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca40c43-deb7-477e-905e-9b426b4bdee0 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:00.413777 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 383/782] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:13:00 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/ecf0479293de4edfbf2815c1e9f2f7cc/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:00.414626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca40c43-deb7-477e-905e-9b426b4bdee0 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.436655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69296bd6-e611-4514-a02e-e050f0c323c9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.474989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b14a2-2795-423e-99ca-3a2fddd7d805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.476269 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b14a2-2795-423e-99ca-3a2fddd7d805 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.476765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b14a2-2795-423e-99ca-3a2fddd7d805 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.477347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b14a2-2795-423e-99ca-3a2fddd7d805 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.478485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b14a2-2795-423e-99ca-3a2fddd7d805 None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:00.479022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b14a2-2795-423e-99ca-3a2fddd7d805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:00.480718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b14a2-2795-423e-99ca-3a2fddd7d805 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:00.490909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 400/783] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:00.492598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b71f37-41ab-46fd-8a79-503a0707bd22 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.493253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b71f37-41ab-46fd-8a79-503a0707bd22 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.493729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b71f37-41ab-46fd-8a79-503a0707bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.512804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-88b71f37-41ab-46fd-8a79-503a0707bd22 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:00.514470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-88b71f37-41ab-46fd-8a79-503a0707bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:00.532295 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca40c43-deb7-477e-905e-9b426b4bdee0 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.568576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2eb246-e9f6-4c12-8b92-f8a72be1dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.569264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eb246-e9f6-4c12-8b92-f8a72be1dfab None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.569568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eb246-e9f6-4c12-8b92-f8a72be1dfab None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.570150 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eb246-e9f6-4c12-8b92-f8a72be1dfab None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.570896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2eb246-e9f6-4c12-8b92-f8a72be1dfab None admin] RBAC: Adding query filter params (interface=public, service_id=3e49e2d07c8c4d3d994d1be8f6abb60e, region_id=RegionOne) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:00.571319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2eb246-e9f6-4c12-8b92-f8a72be1dfab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:00.572807 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2eb246-e9f6-4c12-8b92-f8a72be1dfab None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:00.581386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 384/784] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/endpoints?service_id=3e49e2d07c8c4d3d994d1be8f6abb60e&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:00.582420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2eb246-e9f6-4c12-8b92-f8a72be1dfab None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.590572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 401/785] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:00.591752 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b71f37-41ab-46fd-8a79-503a0707bd22 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.685396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2eb246-e9f6-4c12-8b92-f8a72be1dfab None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.707780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b71f37-41ab-46fd-8a79-503a0707bd22 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.719876 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbcdaf-9a9b-44ad-be4f-85aa644044ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.720679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbcdaf-9a9b-44ad-be4f-85aa644044ce None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.720973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbcdaf-9a9b-44ad-be4f-85aa644044ce None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.721251 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbcdaf-9a9b-44ad-be4f-85aa644044ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.731972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbcdaf-9a9b-44ad-be4f-85aa644044ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:00.733442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbcdaf-9a9b-44ad-be4f-85aa644044ce None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:00.745652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ab22f-e9f6-4fe9-8df1-20b2ba5fd7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.746682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ab22f-e9f6-4fe9-8df1-20b2ba5fd7a9 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.747175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ab22f-e9f6-4fe9-8df1-20b2ba5fd7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.747650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ab22f-e9f6-4fe9-8df1-20b2ba5fd7a9 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.748523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ab22f-e9f6-4fe9-8df1-20b2ba5fd7a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:00.750100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-05cbcdaf-9a9b-44ad-be4f-85aa644044ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:00.750370 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ab22f-e9f6-4fe9-8df1-20b2ba5fd7a9 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:00.751647 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 385/786] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:00.752678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbcdaf-9a9b-44ad-be4f-85aa644044ce None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.756787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 402/787] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:00.757911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ab22f-e9f6-4fe9-8df1-20b2ba5fd7a9 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.859999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbcdaf-9a9b-44ad-be4f-85aa644044ce None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.864860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ab22f-e9f6-4fe9-8df1-20b2ba5fd7a9 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:00.896420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca35b8-f9b1-4428-bbb9-dfe2383eca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.897056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca35b8-f9b1-4428-bbb9-dfe2383eca42 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.897340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca35b8-f9b1-4428-bbb9-dfe2383eca42 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.897618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca35b8-f9b1-4428-bbb9-dfe2383eca42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.902916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d476e7f-2df0-45f0-8e17-a3a665c8becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:00.903878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d476e7f-2df0-45f0-8e17-a3a665c8becb None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:00.904363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d476e7f-2df0-45f0-8e17-a3a665c8becb None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:00.904861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d476e7f-2df0-45f0-8e17-a3a665c8becb None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:00.905836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d476e7f-2df0-45f0-8e17-a3a665c8becb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:00.906365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d476e7f-2df0-45f0-8e17-a3a665c8becb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:00.908004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d476e7f-2df0-45f0-8e17-a3a665c8becb None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:00.909355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca35b8-f9b1-4428-bbb9-dfe2383eca42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:00.916559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-acca35b8-f9b1-4428-bbb9-dfe2383eca42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:13:00.918135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 386/788] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:00.921355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 403/789] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:00.926781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d476e7f-2df0-45f0-8e17-a3a665c8becb None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:00.926946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca35b8-f9b1-4428-bbb9-dfe2383eca42 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:01.045478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca35b8-f9b1-4428-bbb9-dfe2383eca42 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:01.082301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a6df1-1872-48f0-95ba-5309e94dd0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:01.083119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a6df1-1872-48f0-95ba-5309e94dd0e5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:01.083517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a6df1-1872-48f0-95ba-5309e94dd0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:01.083942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a6df1-1872-48f0-95ba-5309e94dd0e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:01.084929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a6df1-1872-48f0-95ba-5309e94dd0e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:01.085336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a6df1-1872-48f0-95ba-5309e94dd0e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:01.086835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a6df1-1872-48f0-95ba-5309e94dd0e5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:01.097487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d476e7f-2df0-45f0-8e17-a3a665c8becb None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:01.098129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 387/790] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:01.104754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a6df1-1872-48f0-95ba-5309e94dd0e5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:01.139502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def62a63-7d8c-468a-a3fe-85b3afb444d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:01.140317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def62a63-7d8c-468a-a3fe-85b3afb444d0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:01.140601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def62a63-7d8c-468a-a3fe-85b3afb444d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:01.140877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def62a63-7d8c-468a-a3fe-85b3afb444d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:01.151774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def62a63-7d8c-468a-a3fe-85b3afb444d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:01.153354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def62a63-7d8c-468a-a3fe-85b3afb444d0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:01.171020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-def62a63-7d8c-468a-a3fe-85b3afb444d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 00:13:01.176922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 404/791] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:13:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:01.178436 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def62a63-7d8c-468a-a3fe-85b3afb444d0 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:01.223666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a6df1-1872-48f0-95ba-5309e94dd0e5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:01.261312 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845a4d-f8fc-44a0-8524-be4cefd4b86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:01.262622 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845a4d-f8fc-44a0-8524-be4cefd4b86a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:01.263115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845a4d-f8fc-44a0-8524-be4cefd4b86a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:01.263593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845a4d-f8fc-44a0-8524-be4cefd4b86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:01.276409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845a4d-f8fc-44a0-8524-be4cefd4b86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:01.278427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845a4d-f8fc-44a0-8524-be4cefd4b86a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:01.297370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-9b845a4d-f8fc-44a0-8524-be4cefd4b86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:01.299628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 388/792] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:01.306856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845a4d-f8fc-44a0-8524-be4cefd4b86a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:01.361307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def62a63-7d8c-468a-a3fe-85b3afb444d0 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:01.428988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845a4d-f8fc-44a0-8524-be4cefd4b86a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:01.430343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36659d2-e96d-4517-bf3c-8b1e20cf5853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:01.431035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36659d2-e96d-4517-bf3c-8b1e20cf5853 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:01.431351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36659d2-e96d-4517-bf3c-8b1e20cf5853 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:01.431628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36659d2-e96d-4517-bf3c-8b1e20cf5853 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:01.433706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36659d2-e96d-4517-bf3c-8b1e20cf5853 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:01.433706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36659d2-e96d-4517-bf3c-8b1e20cf5853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:01.434754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36659d2-e96d-4517-bf3c-8b1e20cf5853 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:01.464873 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 405/793] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 00:13:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:01.471604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36659d2-e96d-4517-bf3c-8b1e20cf5853 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:01.474306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af31342-308d-4379-b2a9-824d4a5edbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:01.475323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af31342-308d-4379-b2a9-824d4a5edbdc None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:01.475813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af31342-308d-4379-b2a9-824d4a5edbdc None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:01.476293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af31342-308d-4379-b2a9-824d4a5edbdc None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:01.477399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af31342-308d-4379-b2a9-824d4a5edbdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:01.477910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af31342-308d-4379-b2a9-824d4a5edbdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:01.479540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af31342-308d-4379-b2a9-824d4a5edbdc None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:01.494285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 389/794] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:01.502365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af31342-308d-4379-b2a9-824d4a5edbdc None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:01.610443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36659d2-e96d-4517-bf3c-8b1e20cf5853 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:01.644075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be428306-5ac0-4f19-ae48-017a1d5e168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:01.645109 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be428306-5ac0-4f19-ae48-017a1d5e168e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:01.645536 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be428306-5ac0-4f19-ae48-017a1d5e168e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:01.645952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be428306-5ac0-4f19-ae48-017a1d5e168e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:01.656461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be428306-5ac0-4f19-ae48-017a1d5e168e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:01.658112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be428306-5ac0-4f19-ae48-017a1d5e168e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:01.677177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-be428306-5ac0-4f19-ae48-017a1d5e168e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:01.678922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 406/795] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:01.684110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be428306-5ac0-4f19-ae48-017a1d5e168e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:01.728185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af31342-308d-4379-b2a9-824d4a5edbdc None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:01.766953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef374f0-ec6a-4589-9eb5-ada2534ce0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:01.767983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef374f0-ec6a-4589-9eb5-ada2534ce0b5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:01.768412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef374f0-ec6a-4589-9eb5-ada2534ce0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:01.768851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef374f0-ec6a-4589-9eb5-ada2534ce0b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:01.777474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef374f0-ec6a-4589-9eb5-ada2534ce0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:01.779351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef374f0-ec6a-4589-9eb5-ada2534ce0b5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:01.795123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-6ef374f0-ec6a-4589-9eb5-ada2534ce0b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 00:13:01.796924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 390/796] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:13:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:01.803214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef374f0-ec6a-4589-9eb5-ada2534ce0b5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:01.889969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be428306-5ac0-4f19-ae48-017a1d5e168e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:01.927926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d8b1-854e-44dd-971c-f6c2df8f7866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:01.928971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d8b1-854e-44dd-971c-f6c2df8f7866 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:01.929454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d8b1-854e-44dd-971c-f6c2df8f7866 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:01.929948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24d8b1-854e-44dd-971c-f6c2df8f7866 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:01.930944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24d8b1-854e-44dd-971c-f6c2df8f7866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:01.931455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24d8b1-854e-44dd-971c-f6c2df8f7866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:01.933584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24d8b1-854e-44dd-971c-f6c2df8f7866 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:01.938896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef374f0-ec6a-4589-9eb5-ada2534ce0b5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:01.946400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 407/797] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:01.960050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d8b1-854e-44dd-971c-f6c2df8f7866 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:01.982559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b1422-9062-41bb-b055-85ccbf8a2d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:01.983082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b1422-9062-41bb-b055-85ccbf8a2d5d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:01.983374 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b1422-9062-41bb-b055-85ccbf8a2d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:01.984432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b1422-9062-41bb-b055-85ccbf8a2d5d None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:01.987791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b1422-9062-41bb-b055-85ccbf8a2d5d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:01.988890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b1422-9062-41bb-b055-85ccbf8a2d5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:01.991815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b1422-9062-41bb-b055-85ccbf8a2d5d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:02.025274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 391/798] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 00:13:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:02.039508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b1422-9062-41bb-b055-85ccbf8a2d5d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:02.094229 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24d8b1-854e-44dd-971c-f6c2df8f7866 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:02.143625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5567dbd-dc8a-4e2a-b150-98dff9b002ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:02.144850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5567dbd-dc8a-4e2a-b150-98dff9b002ef None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.145362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5567dbd-dc8a-4e2a-b150-98dff9b002ef None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.145864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5567dbd-dc8a-4e2a-b150-98dff9b002ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.151262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b1422-9062-41bb-b055-85ccbf8a2d5d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:02.157569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5567dbd-dc8a-4e2a-b150-98dff9b002ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:02.159280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5567dbd-dc8a-4e2a-b150-98dff9b002ef None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:02.187493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-a5567dbd-dc8a-4e2a-b150-98dff9b002ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:02.189523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 408/799] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:02.195070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0f21f-687d-493c-81d7-0a58cb818877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:02.195889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0f21f-687d-493c-81d7-0a58cb818877 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.196175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0f21f-687d-493c-81d7-0a58cb818877 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.196449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae0f21f-687d-493c-81d7-0a58cb818877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.205834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5567dbd-dc8a-4e2a-b150-98dff9b002ef None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:02.208434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0f21f-687d-493c-81d7-0a58cb818877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:02.209999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae0f21f-687d-493c-81d7-0a58cb818877 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:02.227354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-cae0f21f-687d-493c-81d7-0a58cb818877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:02.228880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 392/800] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:02.238993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0f21f-687d-493c-81d7-0a58cb818877 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:02.317554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5567dbd-dc8a-4e2a-b150-98dff9b002ef None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:02.353838 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcfb38-aa49-4d14-8e90-0b235df2223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:02.355172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcfb38-aa49-4d14-8e90-0b235df2223a None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.355457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcfb38-aa49-4d14-8e90-0b235df2223a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.355735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcfb38-aa49-4d14-8e90-0b235df2223a None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.356548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcfb38-aa49-4d14-8e90-0b235df2223a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:02.356860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcfb38-aa49-4d14-8e90-0b235df2223a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:02.358354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcfb38-aa49-4d14-8e90-0b235df2223a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:02.372272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 409/801] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:02.373626 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d670e-5574-466f-828a-03ea9d612d26 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.373914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d670e-5574-466f-828a-03ea9d612d26 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.374193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d670e-5574-466f-828a-03ea9d612d26 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.378312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 410/802] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:02.378312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d670e-5574-466f-828a-03ea9d612d26 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:02.423419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae0f21f-687d-493c-81d7-0a58cb818877 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:02.457759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326b34e-2e2b-493a-b97c-09f0f996ffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:02.458598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b34e-2e2b-493a-b97c-09f0f996ffaa None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.458963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b34e-2e2b-493a-b97c-09f0f996ffaa None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.459327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326b34e-2e2b-493a-b97c-09f0f996ffaa None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.460216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326b34e-2e2b-493a-b97c-09f0f996ffaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:02.460608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326b34e-2e2b-493a-b97c-09f0f996ffaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:02.462097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326b34e-2e2b-493a-b97c-09f0f996ffaa None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:02.473747 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 393/803] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:02.475291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88efbcb-188e-421f-8a91-1ad6cbc45a32 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.475920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88efbcb-188e-421f-8a91-1ad6cbc45a32 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.475920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88efbcb-188e-421f-8a91-1ad6cbc45a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.492994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e88efbcb-188e-421f-8a91-1ad6cbc45a32 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:02.494408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e88efbcb-188e-421f-8a91-1ad6cbc45a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:02.506175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d670e-5574-466f-828a-03ea9d612d26 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:02.539622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f18581-d583-4a9e-9ac1-9f3492fc7a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:02.540544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f18581-d583-4a9e-9ac1-9f3492fc7a74 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.540823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f18581-d583-4a9e-9ac1-9f3492fc7a74 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.541095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f18581-d583-4a9e-9ac1-9f3492fc7a74 None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/085b8de5c190423bb7ba5da5993479f0/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.556107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f18581-d583-4a9e-9ac1-9f3492fc7a74 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=085b8de5c190423bb7ba5da5993479f0, role_id=8ec0a126e9a54afab4f7ee9cd6bbc6c4)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:02.558102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f18581-d583-4a9e-9ac1-9f3492fc7a74 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:02.575477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 411/804] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:13:02 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/085b8de5c190423bb7ba5da5993479f0/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:13:02.576305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f18581-d583-4a9e-9ac1-9f3492fc7a74 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:02.582971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 394/805] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:02.628115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88efbcb-188e-421f-8a91-1ad6cbc45a32 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:02.708668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f18581-d583-4a9e-9ac1-9f3492fc7a74 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:02.750354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696819a0-ac89-4420-9d8e-3f2c0758ce2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:02.751224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696819a0-ac89-4420-9d8e-3f2c0758ce2c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.751509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696819a0-ac89-4420-9d8e-3f2c0758ce2c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.751784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696819a0-ac89-4420-9d8e-3f2c0758ce2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.760421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696819a0-ac89-4420-9d8e-3f2c0758ce2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:02.761868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696819a0-ac89-4420-9d8e-3f2c0758ce2c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:02.777515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-696819a0-ac89-4420-9d8e-3f2c0758ce2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:02.779565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 412/806] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:02.791338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696819a0-ac89-4420-9d8e-3f2c0758ce2c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:02.836888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88efbcb-188e-421f-8a91-1ad6cbc45a32 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:02.875193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e59ba3-856e-462a-88dd-2fe85053d109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:02.876028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e59ba3-856e-462a-88dd-2fe85053d109 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.876314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e59ba3-856e-462a-88dd-2fe85053d109 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.876593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e59ba3-856e-462a-88dd-2fe85053d109 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.877253 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e59ba3-856e-462a-88dd-2fe85053d109 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:02.878841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e59ba3-856e-462a-88dd-2fe85053d109 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:02.891125 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-d2e59ba3-856e-462a-88dd-2fe85053d109 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 12 00:13:02.892651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 395/807] 10.222.0.32 () {56 vars in 1129 bytes} [Tue Apr 12 00:13:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:02.898876 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e59ba3-856e-462a-88dd-2fe85053d109 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:02.899007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696819a0-ac89-4420-9d8e-3f2c0758ce2c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:02.932854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b21745-9e38-4e9b-a734-48e50a06861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:02.933676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b21745-9e38-4e9b-a734-48e50a06861b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:02.933959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b21745-9e38-4e9b-a734-48e50a06861b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:02.935006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b21745-9e38-4e9b-a734-48e50a06861b None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:02.935809 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b21745-9e38-4e9b-a734-48e50a06861b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:02.936118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b21745-9e38-4e9b-a734-48e50a06861b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:02.937524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b21745-9e38-4e9b-a734-48e50a06861b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:02.953322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 413/808] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:02.964796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b21745-9e38-4e9b-a734-48e50a06861b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:03.049316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e59ba3-856e-462a-88dd-2fe85053d109 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:03.085606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4684c-77eb-46d4-8b15-a8e30392efcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:03.086753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4684c-77eb-46d4-8b15-a8e30392efcf None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.087258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4684c-77eb-46d4-8b15-a8e30392efcf None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.087736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4684c-77eb-46d4-8b15-a8e30392efcf None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.088805 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4684c-77eb-46d4-8b15-a8e30392efcf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:03.089311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4684c-77eb-46d4-8b15-a8e30392efcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:03.090939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4684c-77eb-46d4-8b15-a8e30392efcf None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:03.095970 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 396/809] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 00:13:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:03.097425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f8108-663c-4cc4-8748-f30c3b2cf4b1 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.097929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f8108-663c-4cc4-8748-f30c3b2cf4b1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.100898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f8108-663c-4cc4-8748-f30c3b2cf4b1 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.100898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 397/810] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:03.101841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f8108-663c-4cc4-8748-f30c3b2cf4b1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:03.113394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b21745-9e38-4e9b-a734-48e50a06861b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:03.153349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0bfe6-a5b2-4c2e-9adc-37dcb0a71064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:03.154369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0bfe6-a5b2-4c2e-9adc-37dcb0a71064 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.154720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0bfe6-a5b2-4c2e-9adc-37dcb0a71064 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.155058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0bfe6-a5b2-4c2e-9adc-37dcb0a71064 None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/dc91dcec14694193a8e60e32fc138b8f/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.157125 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0bfe6-a5b2-4c2e-9adc-37dcb0a71064 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=dc91dcec14694193a8e60e32fc138b8f, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:03.158676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0bfe6-a5b2-4c2e-9adc-37dcb0a71064 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:03.173930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 414/811] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:13:02 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/dc91dcec14694193a8e60e32fc138b8f/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:03.175467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c37f5-9d99-48f4-8060-f16a077b0212 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.175863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c37f5-9d99-48f4-8060-f16a077b0212 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.176209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c37f5-9d99-48f4-8060-f16a077b0212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.195604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b32c37f5-9d99-48f4-8060-f16a077b0212 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:03.196951 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b32c37f5-9d99-48f4-8060-f16a077b0212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:03.214508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f8108-663c-4cc4-8748-f30c3b2cf4b1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:03.250764 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2c695-7dac-4ae0-9314-6378eb3f78d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:03.251403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2c695-7dac-4ae0-9314-6378eb3f78d4 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.251686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2c695-7dac-4ae0-9314-6378eb3f78d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.251960 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2c695-7dac-4ae0-9314-6378eb3f78d4 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.252668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2c695-7dac-4ae0-9314-6378eb3f78d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:03.252973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2c695-7dac-4ae0-9314-6378eb3f78d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:03.254455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2c695-7dac-4ae0-9314-6378eb3f78d4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:03.260207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 398/812] 10.222.0.32 () {56 vars in 1124 bytes} [Tue Apr 12 00:13:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:03.271281 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2c695-7dac-4ae0-9314-6378eb3f78d4 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:03.274550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 415/813] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:03.327766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c37f5-9d99-48f4-8060-f16a077b0212 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:03.387469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2c695-7dac-4ae0-9314-6378eb3f78d4 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:03.430633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece760e-b17a-4b36-94f4-f649c11ee7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:03.431319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece760e-b17a-4b36-94f4-f649c11ee7a6 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.431602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece760e-b17a-4b36-94f4-f649c11ee7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.431880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece760e-b17a-4b36-94f4-f649c11ee7a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.433169 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece760e-b17a-4b36-94f4-f649c11ee7a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:03.440950 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece760e-b17a-4b36-94f4-f649c11ee7a6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:03.486904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 399/814] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 00:13:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:03.498147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c37f5-9d99-48f4-8060-f16a077b0212 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:03.547535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c051ce-9ab6-43f0-948f-b1d3757b5ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:03.548278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c051ce-9ab6-43f0-948f-b1d3757b5ac2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.548523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c051ce-9ab6-43f0-948f-b1d3757b5ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.548793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c051ce-9ab6-43f0-948f-b1d3757b5ac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.564542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c051ce-9ab6-43f0-948f-b1d3757b5ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:03.571672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-e0c051ce-9ab6-43f0-948f-b1d3757b5ac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:13:03.574545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 416/815] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:03.579390 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece760e-b17a-4b36-94f4-f649c11ee7a6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:03.721220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece760e-b17a-4b36-94f4-f649c11ee7a6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:03.756083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7730833-e51f-48ae-b8e7-dfe8c20a061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:03.756769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730833-e51f-48ae-b8e7-dfe8c20a061f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.757056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730833-e51f-48ae-b8e7-dfe8c20a061f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.757330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7730833-e51f-48ae-b8e7-dfe8c20a061f None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.758087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7730833-e51f-48ae-b8e7-dfe8c20a061f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:03.758420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7730833-e51f-48ae-b8e7-dfe8c20a061f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:03.759796 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7730833-e51f-48ae-b8e7-dfe8c20a061f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:03.769599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 400/816] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:03.777282 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c051ce-9ab6-43f0-948f-b1d3757b5ac2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:03.796542 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122c93-8314-4018-8494-59bd01d6b38a None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.797152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122c93-8314-4018-8494-59bd01d6b38a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.797722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3122c93-8314-4018-8494-59bd01d6b38a None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.799643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 401/817] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:03.804980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87819183-37d6-4abe-983e-376f836b941b None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.805499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87819183-37d6-4abe-983e-376f836b941b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.805973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87819183-37d6-4abe-983e-376f836b941b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.824373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-87819183-37d6-4abe-983e-376f836b941b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:03.825924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-87819183-37d6-4abe-983e-376f836b941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:03.907803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 402/818] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:03.921253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c051ce-9ab6-43f0-948f-b1d3757b5ac2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:03.938367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87819183-37d6-4abe-983e-376f836b941b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:03.958912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e670e4-ed1b-444a-9326-5a4ea454506c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:03.959719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e670e4-ed1b-444a-9326-5a4ea454506c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:03.960007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e670e4-ed1b-444a-9326-5a4ea454506c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:03.960286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e670e4-ed1b-444a-9326-5a4ea454506c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:03.978324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e670e4-ed1b-444a-9326-5a4ea454506c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:03.978324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e670e4-ed1b-444a-9326-5a4ea454506c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:03.994777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-54e670e4-ed1b-444a-9326-5a4ea454506c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:03.996308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 417/819] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:04.001661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e670e4-ed1b-444a-9326-5a4ea454506c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:04.104196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87819183-37d6-4abe-983e-376f836b941b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:04.142010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d7459-c2ca-4809-a6cd-ef3652321c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:04.143592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7459-c2ca-4809-a6cd-ef3652321c18 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:04.143880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7459-c2ca-4809-a6cd-ef3652321c18 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:04.144159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d7459-c2ca-4809-a6cd-ef3652321c18 None admin] PATH_INFO: `/v3/services/network` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:04.144820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d7459-c2ca-4809-a6cd-ef3652321c18 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:04.146193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d7459-c2ca-4809-a6cd-ef3652321c18 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:04.158452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-130d7459-c2ca-4809-a6cd-ef3652321c18 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 12 00:13:04.160585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 403/820] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:03 2022] GET /identity/v3/services/network => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:04.168733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d7459-c2ca-4809-a6cd-ef3652321c18 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:04.195998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e670e4-ed1b-444a-9326-5a4ea454506c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:04.254477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f6ceb-5ed0-4cd8-80ee-888100aa47d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:04.255145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f6ceb-5ed0-4cd8-80ee-888100aa47d7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:04.255423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f6ceb-5ed0-4cd8-80ee-888100aa47d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:04.255692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f6ceb-5ed0-4cd8-80ee-888100aa47d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:04.256404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f6ceb-5ed0-4cd8-80ee-888100aa47d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:04.256703 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f6ceb-5ed0-4cd8-80ee-888100aa47d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:04.258043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f6ceb-5ed0-4cd8-80ee-888100aa47d7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:04.282655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 418/821] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:04.290972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f6ceb-5ed0-4cd8-80ee-888100aa47d7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:04.360908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d7459-c2ca-4809-a6cd-ef3652321c18 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:04.418865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81a4bf-18e9-4702-913e-ba9c4fe9c05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:04.419537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81a4bf-18e9-4702-913e-ba9c4fe9c05e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:04.419818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81a4bf-18e9-4702-913e-ba9c4fe9c05e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:04.420093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81a4bf-18e9-4702-913e-ba9c4fe9c05e None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:04.420801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81a4bf-18e9-4702-913e-ba9c4fe9c05e None admin] RBAC: Adding query filter params (name=network) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:04.421109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81a4bf-18e9-4702-913e-ba9c4fe9c05e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:04.422493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81a4bf-18e9-4702-913e-ba9c4fe9c05e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:04.432745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 404/822] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:04.437176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81a4bf-18e9-4702-913e-ba9c4fe9c05e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:04.443982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f6ceb-5ed0-4cd8-80ee-888100aa47d7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:04.478040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adce7e1-110d-4d14-9e19-844ffab0ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:04.479701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adce7e1-110d-4d14-9e19-844ffab0ba22 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:04.480179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adce7e1-110d-4d14-9e19-844ffab0ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:04.480637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adce7e1-110d-4d14-9e19-844ffab0ba22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:04.488166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adce7e1-110d-4d14-9e19-844ffab0ba22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:04.489853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adce7e1-110d-4d14-9e19-844ffab0ba22 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:04.505198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2adce7e1-110d-4d14-9e19-844ffab0ba22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 00:13:04.511310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 419/823] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 00:13:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:04.516902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adce7e1-110d-4d14-9e19-844ffab0ba22 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:04.639383 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81a4bf-18e9-4702-913e-ba9c4fe9c05e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:04.702487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adce7e1-110d-4d14-9e19-844ffab0ba22 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:04.734978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7a902-5323-4fe8-87f1-f6e5cd718947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:04.735678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7a902-5323-4fe8-87f1-f6e5cd718947 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:04.735957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7a902-5323-4fe8-87f1-f6e5cd718947 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:04.736241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7a902-5323-4fe8-87f1-f6e5cd718947 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:04.736955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7a902-5323-4fe8-87f1-f6e5cd718947 None admin] RBAC: Adding query filter params (type=network) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:04.737266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7a902-5323-4fe8-87f1-f6e5cd718947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:04.738752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7a902-5323-4fe8-87f1-f6e5cd718947 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:04.740725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f95ed-94de-42db-b751-e60190b5ab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:04.741599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f95ed-94de-42db-b751-e60190b5ab7e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:04.742067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f95ed-94de-42db-b751-e60190b5ab7e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:04.744396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f95ed-94de-42db-b751-e60190b5ab7e None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:04.745478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f95ed-94de-42db-b751-e60190b5ab7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:04.745988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f95ed-94de-42db-b751-e60190b5ab7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:04.747612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f95ed-94de-42db-b751-e60190b5ab7e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:04.752376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 405/824] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:04.757873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7a902-5323-4fe8-87f1-f6e5cd718947 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:04.770348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 420/825] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 00:13:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:04.772090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f95ed-94de-42db-b751-e60190b5ab7e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:04.877439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f95ed-94de-42db-b751-e60190b5ab7e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:04.917194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd8301-f1fc-4010-ba19-44fc1d026343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:04.918651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8301-f1fc-4010-ba19-44fc1d026343 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:04.919154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8301-f1fc-4010-ba19-44fc1d026343 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:04.919644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8301-f1fc-4010-ba19-44fc1d026343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:04.965946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7a902-5323-4fe8-87f1-f6e5cd718947 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:04.994533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd8301-f1fc-4010-ba19-44fc1d026343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:04.997114 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd8301-f1fc-4010-ba19-44fc1d026343 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:05.037819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2466f2-d8f7-4fad-9cc8-3abfa8ac6c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:05.038858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2466f2-d8f7-4fad-9cc8-3abfa8ac6c10 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.039145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2466f2-d8f7-4fad-9cc8-3abfa8ac6c10 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.039419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2466f2-d8f7-4fad-9cc8-3abfa8ac6c10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.040158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2466f2-d8f7-4fad-9cc8-3abfa8ac6c10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:05.041594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2466f2-d8f7-4fad-9cc8-3abfa8ac6c10 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:05.090534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 406/826] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 00:13:04 2022] POST /identity/v3/endpoints => generated 327 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:13:05.111944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 421/827] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:13:05.113718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2466f2-d8f7-4fad-9cc8-3abfa8ac6c10 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:05.259113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2466f2-d8f7-4fad-9cc8-3abfa8ac6c10 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:05.289645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdf5a7-3f3d-4868-a094-d520a933c5f7 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.290312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdf5a7-3f3d-4868-a094-d520a933c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.290811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdf5a7-3f3d-4868-a094-d520a933c5f7 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.296400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 422/828] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:05.301818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148d95c-4eda-4064-8ec9-ea58bdb6d6fd None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.302119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148d95c-4eda-4064-8ec9-ea58bdb6d6fd None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.302440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148d95c-4eda-4064-8ec9-ea58bdb6d6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.303860 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad1a7e-4318-4959-9256-238d3d740b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:05.304926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad1a7e-4318-4959-9256-238d3d740b9d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.305434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad1a7e-4318-4959-9256-238d3d740b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.305861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad1a7e-4318-4959-9256-238d3d740b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.319255 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad1a7e-4318-4959-9256-238d3d740b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:05.321076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad1a7e-4318-4959-9256-238d3d740b9d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:05.321542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1148d95c-4eda-4064-8ec9-ea58bdb6d6fd None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:05.323401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1148d95c-4eda-4064-8ec9-ea58bdb6d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:05.342479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-59ad1a7e-4318-4959-9256-238d3d740b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:05.348980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 407/829] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:05.351702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad1a7e-4318-4959-9256-238d3d740b9d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:05.398763 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 423/830] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:05.427138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148d95c-4eda-4064-8ec9-ea58bdb6d6fd None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:05.457067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad1a7e-4318-4959-9256-238d3d740b9d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:05.492839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316de2f-05a7-4509-aec7-e51c25fe7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:05.493846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316de2f-05a7-4509-aec7-e51c25fe7e4b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.494352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316de2f-05a7-4509-aec7-e51c25fe7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.494880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316de2f-05a7-4509-aec7-e51c25fe7e4b None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.495789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316de2f-05a7-4509-aec7-e51c25fe7e4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:05.496288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316de2f-05a7-4509-aec7-e51c25fe7e4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:05.497825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316de2f-05a7-4509-aec7-e51c25fe7e4b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:05.514683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 408/831] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:05.516267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316de2f-05a7-4509-aec7-e51c25fe7e4b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:05.533889 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148d95c-4eda-4064-8ec9-ea58bdb6d6fd None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:05.573554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebba771-448a-4c82-b449-79303838fa24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:05.574771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebba771-448a-4c82-b449-79303838fa24 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.574886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebba771-448a-4c82-b449-79303838fa24 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.575163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebba771-448a-4c82-b449-79303838fa24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.586011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebba771-448a-4c82-b449-79303838fa24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:05.595019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-8ebba771-448a-4c82-b449-79303838fa24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:13:05.597815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 424/832] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:13:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:05.603657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebba771-448a-4c82-b449-79303838fa24 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:05.620504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316de2f-05a7-4509-aec7-e51c25fe7e4b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:05.669977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c46146-798b-4cf6-a43a-15aad3fdfac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:05.671097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c46146-798b-4cf6-a43a-15aad3fdfac2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.671585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c46146-798b-4cf6-a43a-15aad3fdfac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.672036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c46146-798b-4cf6-a43a-15aad3fdfac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.679903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c46146-798b-4cf6-a43a-15aad3fdfac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:05.681709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c46146-798b-4cf6-a43a-15aad3fdfac2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:05.696310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-74c46146-798b-4cf6-a43a-15aad3fdfac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:05.702383 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 409/833] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:05.704938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c46146-798b-4cf6-a43a-15aad3fdfac2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:05.711054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebba771-448a-4c82-b449-79303838fa24 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:05.747011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ae652-a94f-43bc-9242-8c593baa5ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:05.747736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ae652-a94f-43bc-9242-8c593baa5ea2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.748022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ae652-a94f-43bc-9242-8c593baa5ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.748297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ae652-a94f-43bc-9242-8c593baa5ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.749045 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ae652-a94f-43bc-9242-8c593baa5ea2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:05.749350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ae652-a94f-43bc-9242-8c593baa5ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:05.750925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ae652-a94f-43bc-9242-8c593baa5ea2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:05.759647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 425/834] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:13:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:05.765156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ae652-a94f-43bc-9242-8c593baa5ea2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:05.810949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c46146-798b-4cf6-a43a-15aad3fdfac2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:05.850238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e8068-1e11-428a-9631-a0ee4f55475e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:05.851306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e8068-1e11-428a-9631-a0ee4f55475e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.851801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e8068-1e11-428a-9631-a0ee4f55475e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.852296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e8068-1e11-428a-9631-a0ee4f55475e None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.853279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e8068-1e11-428a-9631-a0ee4f55475e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:05.853804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e8068-1e11-428a-9631-a0ee4f55475e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:05.855545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e8068-1e11-428a-9631-a0ee4f55475e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:05.866712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ae652-a94f-43bc-9242-8c593baa5ea2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:05.878462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 410/835] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:05.880117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e8068-1e11-428a-9631-a0ee4f55475e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:05.901464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57203140-184d-421f-aed9-65e8673ece4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:05.902284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57203140-184d-421f-aed9-65e8673ece4c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:05.902586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57203140-184d-421f-aed9-65e8673ece4c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:05.902927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57203140-184d-421f-aed9-65e8673ece4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:05.915747 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57203140-184d-421f-aed9-65e8673ece4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:05.917946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57203140-184d-421f-aed9-65e8673ece4c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:05.936326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-57203140-184d-421f-aed9-65e8673ece4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:05.942471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 426/836] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:05.943331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57203140-184d-421f-aed9-65e8673ece4c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:05.985220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e8068-1e11-428a-9631-a0ee4f55475e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.024595 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f199e1d-5210-4385-bce4-74c17caf7237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.025592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f199e1d-5210-4385-bce4-74c17caf7237 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.026150 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f199e1d-5210-4385-bce4-74c17caf7237 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.026649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f199e1d-5210-4385-bce4-74c17caf7237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.027685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f199e1d-5210-4385-bce4-74c17caf7237 None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=ecf0479293de4edfbf2815c1e9f2f7cc) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:06.028224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f199e1d-5210-4385-bce4-74c17caf7237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:06.029872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f199e1d-5210-4385-bce4-74c17caf7237 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:06.042402 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 411/837] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:05 2022] GET /identity/v3/role_assignments?user.id=ecf0479293de4edfbf2815c1e9f2f7cc&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=f0208c43117c4b799194c83781a46e09 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:06.052159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55072f-6b0e-4d4c-ba61-c49707001e2d None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.052497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55072f-6b0e-4d4c-ba61-c49707001e2d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.052719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55072f-6b0e-4d4c-ba61-c49707001e2d None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.058548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 412/838] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:06.060024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20566d6-400c-4fae-89de-babe33aba6ed None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.060313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20566d6-400c-4fae-89de-babe33aba6ed None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.060591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20566d6-400c-4fae-89de-babe33aba6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.069836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57203140-184d-421f-aed9-65e8673ece4c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.081919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d20566d6-400c-4fae-89de-babe33aba6ed None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:06.083172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d20566d6-400c-4fae-89de-babe33aba6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:06.115243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891838b-a7de-47ef-ba3f-e834b8d8b031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.115937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891838b-a7de-47ef-ba3f-e834b8d8b031 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.116391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891838b-a7de-47ef-ba3f-e834b8d8b031 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.116676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891838b-a7de-47ef-ba3f-e834b8d8b031 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.118020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891838b-a7de-47ef-ba3f-e834b8d8b031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:06.118359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891838b-a7de-47ef-ba3f-e834b8d8b031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:06.120872 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891838b-a7de-47ef-ba3f-e834b8d8b031 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:06.138359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 427/839] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:06.142905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891838b-a7de-47ef-ba3f-e834b8d8b031 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:06.168057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 413/840] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:06.194234 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20566d6-400c-4fae-89de-babe33aba6ed None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:06.257566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891838b-a7de-47ef-ba3f-e834b8d8b031 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.303615 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad0e64-05a8-47f1-a078-8a71bce73148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.304353 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad0e64-05a8-47f1-a078-8a71bce73148 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.304632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad0e64-05a8-47f1-a078-8a71bce73148 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.304905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad0e64-05a8-47f1-a078-8a71bce73148 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.313147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad0e64-05a8-47f1-a078-8a71bce73148 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:06.313975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20566d6-400c-4fae-89de-babe33aba6ed None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.316164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad0e64-05a8-47f1-a078-8a71bce73148 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:06.333357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-a4ad0e64-05a8-47f1-a078-8a71bce73148 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 00:13:06.335004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 428/841] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:06.341015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad0e64-05a8-47f1-a078-8a71bce73148 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:06.349622 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea18c62-9a45-449b-8b38-df244a1a8737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.350560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18c62-9a45-449b-8b38-df244a1a8737 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.350921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18c62-9a45-449b-8b38-df244a1a8737 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.351270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea18c62-9a45-449b-8b38-df244a1a8737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.362044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea18c62-9a45-449b-8b38-df244a1a8737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:06.368962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-1ea18c62-9a45-449b-8b38-df244a1a8737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:13:06.370281 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 414/842] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:06.371441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992d6e-b894-42fc-9b6f-97ad6000c831 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.371724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992d6e-b894-42fc-9b6f-97ad6000c831 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.372003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a992d6e-b894-42fc-9b6f-97ad6000c831 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.373373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 415/843] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:06.375761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992d6e-b894-42fc-9b6f-97ad6000c831 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:06.442111 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad0e64-05a8-47f1-a078-8a71bce73148 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.474772 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c811ee-e90a-4bd9-968a-4423a584a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.475237 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a992d6e-b894-42fc-9b6f-97ad6000c831 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.475451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c811ee-e90a-4bd9-968a-4423a584a467 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.475733 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c811ee-e90a-4bd9-968a-4423a584a467 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.476008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c811ee-e90a-4bd9-968a-4423a584a467 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.476842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c811ee-e90a-4bd9-968a-4423a584a467 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:06.477151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c811ee-e90a-4bd9-968a-4423a584a467 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:06.478594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c811ee-e90a-4bd9-968a-4423a584a467 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:06.495932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 429/844] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:06.498956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e499d-72ea-496c-a6f9-74fb1e39b8ac None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.499389 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e499d-72ea-496c-a6f9-74fb1e39b8ac None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.499810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e499d-72ea-496c-a6f9-74fb1e39b8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.509163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b27a9-11f7-4db5-8e4c-e3bf497a3a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.509834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b27a9-11f7-4db5-8e4c-e3bf497a3a63 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.510197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b27a9-11f7-4db5-8e4c-e3bf497a3a63 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.510503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b27a9-11f7-4db5-8e4c-e3bf497a3a63 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.511253 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b27a9-11f7-4db5-8e4c-e3bf497a3a63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:06.511556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b27a9-11f7-4db5-8e4c-e3bf497a3a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:06.512915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b27a9-11f7-4db5-8e4c-e3bf497a3a63 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:06.516875 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-609e499d-72ea-496c-a6f9-74fb1e39b8ac None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:06.518200 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-609e499d-72ea-496c-a6f9-74fb1e39b8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:06.522300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 416/845] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:06.522463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b27a9-11f7-4db5-8e4c-e3bf497a3a63 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:06.598352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 430/846] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:06.598352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e499d-72ea-496c-a6f9-74fb1e39b8ac None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:06.622470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b27a9-11f7-4db5-8e4c-e3bf497a3a63 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.657681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429b460-2ad1-46e4-9eb8-8d943f22bfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.658681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429b460-2ad1-46e4-9eb8-8d943f22bfa6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.659181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429b460-2ad1-46e4-9eb8-8d943f22bfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.659463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429b460-2ad1-46e4-9eb8-8d943f22bfa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.705997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e499d-72ea-496c-a6f9-74fb1e39b8ac None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.724615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429b460-2ad1-46e4-9eb8-8d943f22bfa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:06.726080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429b460-2ad1-46e4-9eb8-8d943f22bfa6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:06.739029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fc9f8-187a-4a5b-b86e-5e844f52b89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.740374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fc9f8-187a-4a5b-b86e-5e844f52b89b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.740834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fc9f8-187a-4a5b-b86e-5e844f52b89b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.741270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fc9f8-187a-4a5b-b86e-5e844f52b89b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.751152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fc9f8-187a-4a5b-b86e-5e844f52b89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:06.752727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8fc9f8-187a-4a5b-b86e-5e844f52b89b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:06.769618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-1d8fc9f8-187a-4a5b-b86e-5e844f52b89b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:06.770869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 431/847] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:06.771638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fc9f8-187a-4a5b-b86e-5e844f52b89b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:06.828687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 417/848] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:13:06.829563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429b460-2ad1-46e4-9eb8-8d943f22bfa6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:06.874398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fc9f8-187a-4a5b-b86e-5e844f52b89b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.909870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0838638-7201-4130-8834-bc87ee0f6172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.910715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0838638-7201-4130-8834-bc87ee0f6172 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.911002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0838638-7201-4130-8834-bc87ee0f6172 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.911282 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0838638-7201-4130-8834-bc87ee0f6172 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.911932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0838638-7201-4130-8834-bc87ee0f6172 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:06.913592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0838638-7201-4130-8834-bc87ee0f6172 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:06.925215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-f0838638-7201-4130-8834-bc87ee0f6172 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 00:13:06.926429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 432/849] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:06.927198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0838638-7201-4130-8834-bc87ee0f6172 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:06.935802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429b460-2ad1-46e4-9eb8-8d943f22bfa6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:06.972748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040a81b-6ede-464f-a002-68b29e54dbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:06.973726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040a81b-6ede-464f-a002-68b29e54dbe9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:06.974198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040a81b-6ede-464f-a002-68b29e54dbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:06.974691 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040a81b-6ede-464f-a002-68b29e54dbe9 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:06.975586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040a81b-6ede-464f-a002-68b29e54dbe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:06.976067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040a81b-6ede-464f-a002-68b29e54dbe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:06.977582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040a81b-6ede-464f-a002-68b29e54dbe9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:06.990576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 418/850] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:06.991982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040a81b-6ede-464f-a002-68b29e54dbe9 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.028280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0838638-7201-4130-8834-bc87ee0f6172 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.061257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7a16d-ba1a-4e43-adfa-6526601cb793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.062049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7a16d-ba1a-4e43-adfa-6526601cb793 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.062363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7a16d-ba1a-4e43-adfa-6526601cb793 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.062643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7a16d-ba1a-4e43-adfa-6526601cb793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.073797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7a16d-ba1a-4e43-adfa-6526601cb793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.075264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7a16d-ba1a-4e43-adfa-6526601cb793 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.088761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040a81b-6ede-464f-a002-68b29e54dbe9 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.092642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-66a7a16d-ba1a-4e43-adfa-6526601cb793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:07.098424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 433/851] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:07.098424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7a16d-ba1a-4e43-adfa-6526601cb793 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.130710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8ce15-a72f-456e-b8cd-e52e9d204fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.131313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8ce15-a72f-456e-b8cd-e52e9d204fd4 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.131593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8ce15-a72f-456e-b8cd-e52e9d204fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.131865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8ce15-a72f-456e-b8cd-e52e9d204fd4 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.132962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8ce15-a72f-456e-b8cd-e52e9d204fd4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:07.133330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8ce15-a72f-456e-b8cd-e52e9d204fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.135266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8ce15-a72f-456e-b8cd-e52e9d204fd4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.142398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 419/852] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:13:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:07.143314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8ce15-a72f-456e-b8cd-e52e9d204fd4 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.202829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7a16d-ba1a-4e43-adfa-6526601cb793 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.238942 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc8243-a7c0-40d9-be39-b94fa315ecbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.239180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8ce15-a72f-456e-b8cd-e52e9d204fd4 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.239742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc8243-a7c0-40d9-be39-b94fa315ecbe None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.240026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc8243-a7c0-40d9-be39-b94fa315ecbe None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.240303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc8243-a7c0-40d9-be39-b94fa315ecbe None admin] PATH_INFO: `/v3/users/swift` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.248635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc8243-a7c0-40d9-be39-b94fa315ecbe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.250106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc8243-a7c0-40d9-be39-b94fa315ecbe None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.264449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-28fc8243-a7c0-40d9-be39-b94fa315ecbe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 12 00:13:07.270599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 434/853] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:13:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:07.270599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc8243-a7c0-40d9-be39-b94fa315ecbe None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.274359 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d0e5a-d3b1-4c8c-baa7-952f6015ce1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.275025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d0e5a-d3b1-4c8c-baa7-952f6015ce1c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.275304 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d0e5a-d3b1-4c8c-baa7-952f6015ce1c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.275576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d0e5a-d3b1-4c8c-baa7-952f6015ce1c None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.276841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d0e5a-d3b1-4c8c-baa7-952f6015ce1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:07.277141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d0e5a-d3b1-4c8c-baa7-952f6015ce1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.278519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d0e5a-d3b1-4c8c-baa7-952f6015ce1c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.294894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 420/854] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:07.294894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d0e5a-d3b1-4c8c-baa7-952f6015ce1c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.370124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc8243-a7c0-40d9-be39-b94fa315ecbe None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.385921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d0e5a-d3b1-4c8c-baa7-952f6015ce1c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.402505 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50472b-0684-4dd9-af09-83657d658af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.403231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50472b-0684-4dd9-af09-83657d658af0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.403520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50472b-0684-4dd9-af09-83657d658af0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.403811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50472b-0684-4dd9-af09-83657d658af0 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.404531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50472b-0684-4dd9-af09-83657d658af0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:07.404840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50472b-0684-4dd9-af09-83657d658af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.406181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50472b-0684-4dd9-af09-83657d658af0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.410460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 435/855] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:13:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:07.411224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50472b-0684-4dd9-af09-83657d658af0 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.427793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7cdfb-33c1-4042-b1bd-691d4d6687b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.428937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7cdfb-33c1-4042-b1bd-691d4d6687b3 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.429417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7cdfb-33c1-4042-b1bd-691d4d6687b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.429891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7cdfb-33c1-4042-b1bd-691d4d6687b3 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.431017 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7cdfb-33c1-4042-b1bd-691d4d6687b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:07.431563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7cdfb-33c1-4042-b1bd-691d4d6687b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.433425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7cdfb-33c1-4042-b1bd-691d4d6687b3 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.454418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 421/856] 10.222.0.32 () {56 vars in 1135 bytes} [Tue Apr 12 00:13:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:07.459590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7cdfb-33c1-4042-b1bd-691d4d6687b3 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.517254 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50472b-0684-4dd9-af09-83657d658af0 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.553485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3c3b0-b974-4e8c-adcc-e15e1cdfcd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.554334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3c3b0-b974-4e8c-adcc-e15e1cdfcd77 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.554958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3c3b0-b974-4e8c-adcc-e15e1cdfcd77 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.554958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3c3b0-b974-4e8c-adcc-e15e1cdfcd77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.562554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3c3b0-b974-4e8c-adcc-e15e1cdfcd77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.564024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e3c3b0-b974-4e8c-adcc-e15e1cdfcd77 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.575427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7cdfb-33c1-4042-b1bd-691d4d6687b3 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.578948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-a2e3c3b0-b974-4e8c-adcc-e15e1cdfcd77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:07.580217 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 436/857] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:07.586245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3c3b0-b974-4e8c-adcc-e15e1cdfcd77 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.616352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd163dac-c27f-459d-883f-2930bb36b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.617016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd163dac-c27f-459d-883f-2930bb36b378 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.617994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd163dac-c27f-459d-883f-2930bb36b378 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.617994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd163dac-c27f-459d-883f-2930bb36b378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.709847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3c3b0-b974-4e8c-adcc-e15e1cdfcd77 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.711484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd163dac-c27f-459d-883f-2930bb36b378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.713855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd163dac-c27f-459d-883f-2930bb36b378 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.747442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408e3e9-ba30-4bef-959d-2024568058b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.748105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408e3e9-ba30-4bef-959d-2024568058b7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.748559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408e3e9-ba30-4bef-959d-2024568058b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.748845 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408e3e9-ba30-4bef-959d-2024568058b7 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.750201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408e3e9-ba30-4bef-959d-2024568058b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:07.750539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408e3e9-ba30-4bef-959d-2024568058b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.751965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408e3e9-ba30-4bef-959d-2024568058b7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.766673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 437/858] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:07.772691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408e3e9-ba30-4bef-959d-2024568058b7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.832381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 422/859] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:13:07.833713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd163dac-c27f-459d-883f-2930bb36b378 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:07.905251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408e3e9-ba30-4bef-959d-2024568058b7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.942843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd163dac-c27f-459d-883f-2930bb36b378 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:07.948737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957f6db-a92d-40bb-a798-e77c98609b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.949614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957f6db-a92d-40bb-a798-e77c98609b88 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.950078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957f6db-a92d-40bb-a798-e77c98609b88 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.950555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957f6db-a92d-40bb-a798-e77c98609b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.951557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957f6db-a92d-40bb-a798-e77c98609b88 None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=085b8de5c190423bb7ba5da5993479f0) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:07.952481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957f6db-a92d-40bb-a798-e77c98609b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.954471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957f6db-a92d-40bb-a798-e77c98609b88 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:07.968672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 438/860] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:07 2022] GET /identity/v3/role_assignments?user.id=085b8de5c190423bb7ba5da5993479f0&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:07.983951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cc675-ba14-40a0-879f-9aef50da62cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:07.984767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc675-ba14-40a0-879f-9aef50da62cd None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:07.985049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc675-ba14-40a0-879f-9aef50da62cd None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:07.985320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cc675-ba14-40a0-879f-9aef50da62cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:07.997157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cc675-ba14-40a0-879f-9aef50da62cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:07.998654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cc675-ba14-40a0-879f-9aef50da62cd None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:08.018085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-571cc675-ba14-40a0-879f-9aef50da62cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:08.019753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 423/861] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:08.025341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957f6db-a92d-40bb-a798-e77c98609b88 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:08.140443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957f6db-a92d-40bb-a798-e77c98609b88 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:08.178700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58a738-8c22-4476-9769-006551f620a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:08.179796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58a738-8c22-4476-9769-006551f620a2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:08.180285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58a738-8c22-4476-9769-006551f620a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:08.180776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58a738-8c22-4476-9769-006551f620a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:08.181716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58a738-8c22-4476-9769-006551f620a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:08.182287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58a738-8c22-4476-9769-006551f620a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:08.183912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58a738-8c22-4476-9769-006551f620a2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:08.197409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 439/862] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:08.204059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cc675-ba14-40a0-879f-9aef50da62cd None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:08.303262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cc675-ba14-40a0-879f-9aef50da62cd None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:08.339487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01a647-58f9-491f-9738-2859b0dce6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:08.340562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01a647-58f9-491f-9738-2859b0dce6e2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:08.341017 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01a647-58f9-491f-9738-2859b0dce6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:08.341472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01a647-58f9-491f-9738-2859b0dce6e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:08.348505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01a647-58f9-491f-9738-2859b0dce6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:08.350119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01a647-58f9-491f-9738-2859b0dce6e2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:08.363900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-ec01a647-58f9-491f-9738-2859b0dce6e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:08.365639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 424/863] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:08.371695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58a738-8c22-4476-9769-006551f620a2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:08.464247 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c12c5-1201-41d6-82e0-65f9a8cdaea2 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:08.464432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c12c5-1201-41d6-82e0-65f9a8cdaea2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:08.464717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c12c5-1201-41d6-82e0-65f9a8cdaea2 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:08.466335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 425/864] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:08.471198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595851d0-ac70-4867-bbfb-444849a1a679 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:08.471547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595851d0-ac70-4867-bbfb-444849a1a679 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:08.471754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595851d0-ac70-4867-bbfb-444849a1a679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:08.473783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58a738-8c22-4476-9769-006551f620a2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:08.489159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-595851d0-ac70-4867-bbfb-444849a1a679 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:08.490205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-595851d0-ac70-4867-bbfb-444849a1a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:08.509628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7535102-2995-4458-b595-8894bd7dad50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:08.510722 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7535102-2995-4458-b595-8894bd7dad50 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:08.511009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7535102-2995-4458-b595-8894bd7dad50 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:08.511286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7535102-2995-4458-b595-8894bd7dad50 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:08.512074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7535102-2995-4458-b595-8894bd7dad50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:08.512383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7535102-2995-4458-b595-8894bd7dad50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:08.513807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7535102-2995-4458-b595-8894bd7dad50 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:08.530379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 440/865] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:08.539419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7535102-2995-4458-b595-8894bd7dad50 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:08.571327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 426/866] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:08.593268 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595851d0-ac70-4867-bbfb-444849a1a679 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:08.664591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7535102-2995-4458-b595-8894bd7dad50 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:08.704459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d957-39e0-4700-b4d1-cdfb9024190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:08.705550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d957-39e0-4700-b4d1-cdfb9024190a None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:08.705977 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d957-39e0-4700-b4d1-cdfb9024190a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:08.706272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50d957-39e0-4700-b4d1-cdfb9024190a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:08.707281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d957-39e0-4700-b4d1-cdfb9024190a None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=dc91dcec14694193a8e60e32fc138b8f) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:08.707890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d957-39e0-4700-b4d1-cdfb9024190a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:08.709572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50d957-39e0-4700-b4d1-cdfb9024190a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:08.714382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595851d0-ac70-4867-bbfb-444849a1a679 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:08.722354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 441/867] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:08 2022] GET /identity/v3/role_assignments?user.id=dc91dcec14694193a8e60e32fc138b8f&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=f0208c43117c4b799194c83781a46e09 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:08.749967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9550c9f-c6fa-45ae-8b6f-c3bec04f7996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:08.750835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9550c9f-c6fa-45ae-8b6f-c3bec04f7996 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:08.751165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9550c9f-c6fa-45ae-8b6f-c3bec04f7996 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:08.751442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9550c9f-c6fa-45ae-8b6f-c3bec04f7996 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:08.752103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9550c9f-c6fa-45ae-8b6f-c3bec04f7996 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:08.753519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9550c9f-c6fa-45ae-8b6f-c3bec04f7996 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:08.765657 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-a9550c9f-c6fa-45ae-8b6f-c3bec04f7996 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 00:13:08.767328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 427/868] 10.222.0.32 () {56 vars in 1132 bytes} [Tue Apr 12 00:13:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:08.774713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d957-39e0-4700-b4d1-cdfb9024190a None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:08.881955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50d957-39e0-4700-b4d1-cdfb9024190a None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:08.918592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1edd3-7b11-467b-ace8-c674d478dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:08.919265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1edd3-7b11-467b-ace8-c674d478dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:08.919544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1edd3-7b11-467b-ace8-c674d478dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:08.919817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1edd3-7b11-467b-ace8-c674d478dbd6 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:08.920516 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1edd3-7b11-467b-ace8-c674d478dbd6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:08.920814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1edd3-7b11-467b-ace8-c674d478dbd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:08.922166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1edd3-7b11-467b-ace8-c674d478dbd6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:08.927001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 442/869] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:08.932575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9550c9f-c6fa-45ae-8b6f-c3bec04f7996 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:09.031848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9550c9f-c6fa-45ae-8b6f-c3bec04f7996 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:09.068753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bccd61-040d-46e8-a8fb-3f3f0269a9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:09.069793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bccd61-040d-46e8-a8fb-3f3f0269a9d9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:09.070305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bccd61-040d-46e8-a8fb-3f3f0269a9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:09.070797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bccd61-040d-46e8-a8fb-3f3f0269a9d9 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:09.071696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bccd61-040d-46e8-a8fb-3f3f0269a9d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:09.072214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bccd61-040d-46e8-a8fb-3f3f0269a9d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:09.074315 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bccd61-040d-46e8-a8fb-3f3f0269a9d9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:09.079561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 428/870] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:09.791974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4547b2-2dee-4267-9e3c-5bc43faf26c4 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:09.793039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4547b2-2dee-4267-9e3c-5bc43faf26c4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:09.793586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4547b2-2dee-4267-9e3c-5bc43faf26c4 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:09.795584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 443/871] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:09.800972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3638c-f24a-4148-96c8-fc2308949a5c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:09.801507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3638c-f24a-4148-96c8-fc2308949a5c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:09.802031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3638c-f24a-4148-96c8-fc2308949a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:09.819774 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-88b3638c-f24a-4148-96c8-fc2308949a5c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:09.821286 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-88b3638c-f24a-4148-96c8-fc2308949a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:09.890309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 429/872] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:09.915574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4547b2-2dee-4267-9e3c-5bc43faf26c4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:10.017201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4547b2-2dee-4267-9e3c-5bc43faf26c4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:10.054650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807cdd6-40e5-477c-9b6e-d2ea95576c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:10.055486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807cdd6-40e5-477c-9b6e-d2ea95576c9b None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:10.055774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807cdd6-40e5-477c-9b6e-d2ea95576c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:10.056047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807cdd6-40e5-477c-9b6e-d2ea95576c9b None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:10.056766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807cdd6-40e5-477c-9b6e-d2ea95576c9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:10.058783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807cdd6-40e5-477c-9b6e-d2ea95576c9b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:10.075507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 444/873] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:13:09 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:10.513812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069fb6c-753d-4862-9a9e-b7697adaccd2 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:10.514877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069fb6c-753d-4862-9a9e-b7697adaccd2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:10.515365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069fb6c-753d-4862-9a9e-b7697adaccd2 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:10.517199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 430/874] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:10.522840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e2773-c4fd-460a-aae0-48f75c2a659d None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:10.523364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e2773-c4fd-460a-aae0-48f75c2a659d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:10.523839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e2773-c4fd-460a-aae0-48f75c2a659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:10.542098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1a0e2773-c4fd-460a-aae0-48f75c2a659d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:10.543630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1a0e2773-c4fd-460a-aae0-48f75c2a659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:10.619555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 445/875] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:10 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:10.644747 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069fb6c-753d-4862-9a9e-b7697adaccd2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:10.758049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069fb6c-753d-4862-9a9e-b7697adaccd2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:10.797388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea8b70-aee1-445d-bd17-686aa97a9999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:10.798192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8b70-aee1-445d-bd17-686aa97a9999 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:10.798514 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8b70-aee1-445d-bd17-686aa97a9999 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:10.798788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8b70-aee1-445d-bd17-686aa97a9999 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:10.809818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea8b70-aee1-445d-bd17-686aa97a9999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:10.817435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-7fea8b70-aee1-445d-bd17-686aa97a9999 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 00:13:10.819054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 431/876] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 00:13:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:10.824921 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e2773-c4fd-460a-aae0-48f75c2a659d None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:10.924602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e2773-c4fd-460a-aae0-48f75c2a659d None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:10.959308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82c1e6-ed74-4858-9fed-6128dc961608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:10.960349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82c1e6-ed74-4858-9fed-6128dc961608 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:10.960834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82c1e6-ed74-4858-9fed-6128dc961608 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:10.961308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82c1e6-ed74-4858-9fed-6128dc961608 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:10.962270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82c1e6-ed74-4858-9fed-6128dc961608 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:10.962793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82c1e6-ed74-4858-9fed-6128dc961608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:10.964904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82c1e6-ed74-4858-9fed-6128dc961608 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:10.978055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 446/877] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 00:13:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:10.979766 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea8b70-aee1-445d-bd17-686aa97a9999 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:11.082350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea8b70-aee1-445d-bd17-686aa97a9999 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:11.116743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2b7ce-0f43-4c41-9719-31a7e7953e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:11.117908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2b7ce-0f43-4c41-9719-31a7e7953e3f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.118420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2b7ce-0f43-4c41-9719-31a7e7953e3f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.118894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2b7ce-0f43-4c41-9719-31a7e7953e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.129614 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2b7ce-0f43-4c41-9719-31a7e7953e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:11.131431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2b7ce-0f43-4c41-9719-31a7e7953e3f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:11.148362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-55c2b7ce-0f43-4c41-9719-31a7e7953e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:11.153576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360df3b-458a-4a31-b984-ed3e1f111ef4 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.153576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360df3b-458a-4a31-b984-ed3e1f111ef4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.153576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360df3b-458a-4a31-b984-ed3e1f111ef4 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.153576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 447/879] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:11.154096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 432/879] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:11.157035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360df3b-458a-4a31-b984-ed3e1f111ef4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:11.158697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b995f0-3412-4157-a913-5f2b8e594a38 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.158991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b995f0-3412-4157-a913-5f2b8e594a38 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.159274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b995f0-3412-4157-a913-5f2b8e594a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.176914 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d4b995f0-3412-4157-a913-5f2b8e594a38 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:11.178083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d4b995f0-3412-4157-a913-5f2b8e594a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:11.250530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 433/880] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:11.261773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360df3b-458a-4a31-b984-ed3e1f111ef4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:11.267509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b995f0-3412-4157-a913-5f2b8e594a38 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:11.296636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f82f18-2d8b-4dd9-a95d-28ebf4cc9932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:11.298774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82f18-2d8b-4dd9-a95d-28ebf4cc9932 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.299931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82f18-2d8b-4dd9-a95d-28ebf4cc9932 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.300410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82f18-2d8b-4dd9-a95d-28ebf4cc9932 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.301999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f82f18-2d8b-4dd9-a95d-28ebf4cc9932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:11.302355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f82f18-2d8b-4dd9-a95d-28ebf4cc9932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:11.304079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f82f18-2d8b-4dd9-a95d-28ebf4cc9932 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:11.325287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 448/881] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:11.327275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f82f18-2d8b-4dd9-a95d-28ebf4cc9932 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:11.377372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b995f0-3412-4157-a913-5f2b8e594a38 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:11.411744 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf53236-8f9c-445d-b7a8-edaea81b5ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:11.412556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf53236-8f9c-445d-b7a8-edaea81b5ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.412842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf53236-8f9c-445d-b7a8-edaea81b5ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.413371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf53236-8f9c-445d-b7a8-edaea81b5ee0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.414020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf53236-8f9c-445d-b7a8-edaea81b5ee0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:11.415428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf53236-8f9c-445d-b7a8-edaea81b5ee0 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:11.426882 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-bbf53236-8f9c-445d-b7a8-edaea81b5ee0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 00:13:11.430470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 434/882] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:11.432544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a601dc8-5c1e-4aa3-9b6f-9a4937c89394 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.432834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a601dc8-5c1e-4aa3-9b6f-9a4937c89394 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.433111 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a601dc8-5c1e-4aa3-9b6f-9a4937c89394 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.434730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 435/883] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:11.439177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a601dc8-5c1e-4aa3-9b6f-9a4937c89394 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:11.443063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f82f18-2d8b-4dd9-a95d-28ebf4cc9932 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:11.477086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db82b1-100f-442e-9fa9-e98c517cb1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:11.477891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db82b1-100f-442e-9fa9-e98c517cb1cb None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.478175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db82b1-100f-442e-9fa9-e98c517cb1cb None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.478478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db82b1-100f-442e-9fa9-e98c517cb1cb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.485773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db82b1-100f-442e-9fa9-e98c517cb1cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:11.487215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db82b1-100f-442e-9fa9-e98c517cb1cb None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:11.501358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-30db82b1-100f-442e-9fa9-e98c517cb1cb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 00:13:11.502720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 449/884] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:13:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:11.503850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2671192-9a7a-4f89-942a-c4ec8cd9e279 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.504140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2671192-9a7a-4f89-942a-c4ec8cd9e279 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.504419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2671192-9a7a-4f89-942a-c4ec8cd9e279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.521866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c2671192-9a7a-4f89-942a-c4ec8cd9e279 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:11.523054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c2671192-9a7a-4f89-942a-c4ec8cd9e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:11.540862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a601dc8-5c1e-4aa3-9b6f-9a4937c89394 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:11.573983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52f8eb-3a58-41c2-b013-1f8b8e0afcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:11.574754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52f8eb-3a58-41c2-b013-1f8b8e0afcee None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.575039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52f8eb-3a58-41c2-b013-1f8b8e0afcee None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.575321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52f8eb-3a58-41c2-b013-1f8b8e0afcee None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.576019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52f8eb-3a58-41c2-b013-1f8b8e0afcee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:11.576323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52f8eb-3a58-41c2-b013-1f8b8e0afcee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:11.577682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52f8eb-3a58-41c2-b013-1f8b8e0afcee None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:11.586412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 436/885] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:11.586412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52f8eb-3a58-41c2-b013-1f8b8e0afcee None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:11.592350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 450/886] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:11 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:11.593336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2671192-9a7a-4f89-942a-c4ec8cd9e279 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:11.697399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2671192-9a7a-4f89-942a-c4ec8cd9e279 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:11.700609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52f8eb-3a58-41c2-b013-1f8b8e0afcee None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:11.730298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797663-a498-4b05-b483-6216c1411327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:11.730855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797663-a498-4b05-b483-6216c1411327 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.731143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797663-a498-4b05-b483-6216c1411327 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.731421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797663-a498-4b05-b483-6216c1411327 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.732134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797663-a498-4b05-b483-6216c1411327 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:11.732440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797663-a498-4b05-b483-6216c1411327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:11.733814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797663-a498-4b05-b483-6216c1411327 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:11.737954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc12300-b076-4264-95cc-fc867763c412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:11.746415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 451/887] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:11.746625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc12300-b076-4264-95cc-fc867763c412 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.746625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc12300-b076-4264-95cc-fc867763c412 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.746625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc12300-b076-4264-95cc-fc867763c412 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.746840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797663-a498-4b05-b483-6216c1411327 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:11.746918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc12300-b076-4264-95cc-fc867763c412 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:11.746918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc12300-b076-4264-95cc-fc867763c412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:11.746918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc12300-b076-4264-95cc-fc867763c412 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:11.766376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 437/888] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 00:13:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:11.767369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc12300-b076-4264-95cc-fc867763c412 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:11.862455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797663-a498-4b05-b483-6216c1411327 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:11.873769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc12300-b076-4264-95cc-fc867763c412 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:11.899158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8e68-3e68-4e60-8f70-60c45dd8331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:11.899843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8e68-3e68-4e60-8f70-60c45dd8331f None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.900128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8e68-3e68-4e60-8f70-60c45dd8331f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.900405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a8e68-3e68-4e60-8f70-60c45dd8331f None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.901240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a8e68-3e68-4e60-8f70-60c45dd8331f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:11.902764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a8e68-3e68-4e60-8f70-60c45dd8331f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:11.910768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfe08f-4f6d-4736-95db-b1e6112c04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:11.911433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfe08f-4f6d-4736-95db-b1e6112c04f6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:11.911716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfe08f-4f6d-4736-95db-b1e6112c04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:11.912067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfe08f-4f6d-4736-95db-b1e6112c04f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:11.920219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 452/889] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:13:11 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:11.993635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfe08f-4f6d-4736-95db-b1e6112c04f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:11.995793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddfe08f-4f6d-4736-95db-b1e6112c04f6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:12.108268 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 438/890] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:11 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:13:12.114133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8e68-3e68-4e60-8f70-60c45dd8331f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:12.226535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a8e68-3e68-4e60-8f70-60c45dd8331f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:12.259532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec4ed9-fdff-4e7b-bd30-4e3873925c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:12.260357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec4ed9-fdff-4e7b-bd30-4e3873925c4a None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:12.260637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec4ed9-fdff-4e7b-bd30-4e3873925c4a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:12.260911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec4ed9-fdff-4e7b-bd30-4e3873925c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:12.271322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec4ed9-fdff-4e7b-bd30-4e3873925c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:12.272755 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec4ed9-fdff-4e7b-bd30-4e3873925c4a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:12.289461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-38ec4ed9-fdff-4e7b-bd30-4e3873925c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:12.291017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 453/891] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:12.296633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfe08f-4f6d-4736-95db-b1e6112c04f6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:12.393490 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfe08f-4f6d-4736-95db-b1e6112c04f6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:12.426073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa07661-fc1e-48bf-a38d-261c1cd26520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:12.426762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa07661-fc1e-48bf-a38d-261c1cd26520 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:12.427043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa07661-fc1e-48bf-a38d-261c1cd26520 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:12.427318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa07661-fc1e-48bf-a38d-261c1cd26520 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:12.428021 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa07661-fc1e-48bf-a38d-261c1cd26520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:12.428320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa07661-fc1e-48bf-a38d-261c1cd26520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:12.429676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa07661-fc1e-48bf-a38d-261c1cd26520 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:12.441327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 439/892] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:12.446718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec4ed9-fdff-4e7b-bd30-4e3873925c4a None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:12.530394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b26fef-02b0-4e52-beb0-c7f91119b2ac None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:12.530684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b26fef-02b0-4e52-beb0-c7f91119b2ac None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:12.530888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b26fef-02b0-4e52-beb0-c7f91119b2ac None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:12.533445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 440/893] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:12.537321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f50a-daaa-4b6d-b440-d0707b25482f None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:12.537615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f50a-daaa-4b6d-b440-d0707b25482f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:12.537897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138f50a-daaa-4b6d-b440-d0707b25482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:12.548688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec4ed9-fdff-4e7b-bd30-4e3873925c4a None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:12.557596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b138f50a-daaa-4b6d-b440-d0707b25482f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:12.558814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b138f50a-daaa-4b6d-b440-d0707b25482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:12.585816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f588d6-8dec-4987-a0a4-62095ac9496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:12.587012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f588d6-8dec-4987-a0a4-62095ac9496f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:12.587501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f588d6-8dec-4987-a0a4-62095ac9496f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:12.587998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f588d6-8dec-4987-a0a4-62095ac9496f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:12.596173 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f588d6-8dec-4987-a0a4-62095ac9496f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:12.597832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f588d6-8dec-4987-a0a4-62095ac9496f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:12.614899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-b4f588d6-8dec-4987-a0a4-62095ac9496f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:12.617195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 454/894] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:12.622591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f588d6-8dec-4987-a0a4-62095ac9496f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:12.642279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 441/895] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:12.671804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138f50a-daaa-4b6d-b440-d0707b25482f None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:12.741888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f588d6-8dec-4987-a0a4-62095ac9496f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:12.783341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcca05-a5e1-4b6f-b6c1-6617f4b2e1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:12.784534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcca05-a5e1-4b6f-b6c1-6617f4b2e1bc None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:12.785006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcca05-a5e1-4b6f-b6c1-6617f4b2e1bc None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:12.785463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcca05-a5e1-4b6f-b6c1-6617f4b2e1bc None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:12.785988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138f50a-daaa-4b6d-b440-d0707b25482f None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:12.786648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcca05-a5e1-4b6f-b6c1-6617f4b2e1bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:12.787153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcca05-a5e1-4b6f-b6c1-6617f4b2e1bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:12.789974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcca05-a5e1-4b6f-b6c1-6617f4b2e1bc None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:12.805479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 455/896] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:12.812227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcca05-a5e1-4b6f-b6c1-6617f4b2e1bc None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:12.831478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382a6df-4aa6-4bf1-b713-d733f2e68038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:12.832279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382a6df-4aa6-4bf1-b713-d733f2e68038 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:12.832611 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382a6df-4aa6-4bf1-b713-d733f2e68038 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:12.832936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382a6df-4aa6-4bf1-b713-d733f2e68038 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:12.833528 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382a6df-4aa6-4bf1-b713-d733f2e68038 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:12.834928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382a6df-4aa6-4bf1-b713-d733f2e68038 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:12.846779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-a382a6df-4aa6-4bf1-b713-d733f2e68038 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 00:13:12.852866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 442/897] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:13:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:12.854765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382a6df-4aa6-4bf1-b713-d733f2e68038 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:12.927990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcca05-a5e1-4b6f-b6c1-6617f4b2e1bc None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:12.955178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382a6df-4aa6-4bf1-b713-d733f2e68038 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:12.971956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644ed63-a406-4178-bb59-6d686dffe279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:12.972873 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ed63-a406-4178-bb59-6d686dffe279 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:12.973224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ed63-a406-4178-bb59-6d686dffe279 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:12.973568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644ed63-a406-4178-bb59-6d686dffe279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:12.974794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644ed63-a406-4178-bb59-6d686dffe279 None admin] RBAC: Adding query filter params (role.id=ed1b3a4e24f2471288b84816ceb586c6, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=085b8de5c190423bb7ba5da5993479f0) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:12.975174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644ed63-a406-4178-bb59-6d686dffe279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:12.976679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644ed63-a406-4178-bb59-6d686dffe279 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:12.986288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 456/898] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:12 2022] GET /identity/v3/role_assignments?user.id=085b8de5c190423bb7ba5da5993479f0&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=ed1b3a4e24f2471288b84816ceb586c6 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:13.002570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7c523-de55-4af8-8025-2011aecd43fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:13.003784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7c523-de55-4af8-8025-2011aecd43fc None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:13.004321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7c523-de55-4af8-8025-2011aecd43fc None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:13.004802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7c523-de55-4af8-8025-2011aecd43fc None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:13.005755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7c523-de55-4af8-8025-2011aecd43fc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:13.006303 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7c523-de55-4af8-8025-2011aecd43fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:13.008055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7c523-de55-4af8-8025-2011aecd43fc None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:13.018415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 443/899] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:13:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:13.020701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644ed63-a406-4178-bb59-6d686dffe279 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:13.131864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644ed63-a406-4178-bb59-6d686dffe279 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:13.169681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848af0a-e1d1-4a50-a465-c36a9795efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:13.170779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848af0a-e1d1-4a50-a465-c36a9795efaf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:13.171266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848af0a-e1d1-4a50-a465-c36a9795efaf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:13.171742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848af0a-e1d1-4a50-a465-c36a9795efaf None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:13.172668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848af0a-e1d1-4a50-a465-c36a9795efaf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:13.173199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848af0a-e1d1-4a50-a465-c36a9795efaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:13.174801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848af0a-e1d1-4a50-a465-c36a9795efaf None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:13.185672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 457/900] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:13:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:13.187069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7c523-de55-4af8-8025-2011aecd43fc None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:13.282681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7c523-de55-4af8-8025-2011aecd43fc None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:13.316411 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f21c7b-ab05-4080-9928-e3bcacfbc9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:13.317067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f21c7b-ab05-4080-9928-e3bcacfbc9f2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:13.317349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f21c7b-ab05-4080-9928-e3bcacfbc9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:13.317624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f21c7b-ab05-4080-9928-e3bcacfbc9f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:13.318430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f21c7b-ab05-4080-9928-e3bcacfbc9f2 None admin] RBAC: Adding query filter params (interface=public, service_id=250f361744f84b57866e4727cd49938d, region_id=RegionOne) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:13.318743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f21c7b-ab05-4080-9928-e3bcacfbc9f2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:13.320206 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f21c7b-ab05-4080-9928-e3bcacfbc9f2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:13.325834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 444/901] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 00:13:13 2022] GET /identity/v3/endpoints?service_id=250f361744f84b57866e4727cd49938d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:13.331444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848af0a-e1d1-4a50-a465-c36a9795efaf None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:13.430400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848af0a-e1d1-4a50-a465-c36a9795efaf None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:13.464001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec76a56-8547-495f-b9a1-89b3eb7aaf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:13.465013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76a56-8547-495f-b9a1-89b3eb7aaf03 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:13.465516 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76a56-8547-495f-b9a1-89b3eb7aaf03 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:13.465988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76a56-8547-495f-b9a1-89b3eb7aaf03 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:13.466891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec76a56-8547-495f-b9a1-89b3eb7aaf03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:13.468430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec76a56-8547-495f-b9a1-89b3eb7aaf03 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:13.479161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 458/902] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 00:13:13 2022] GET /identity/v3/services => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:14.182322 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5a90-e2ae-41ff-9907-e695223afcee None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:14.183354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5a90-e2ae-41ff-9907-e695223afcee None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:14.183862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5a90-e2ae-41ff-9907-e695223afcee None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:14.185699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 445/903] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:14.191503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852cb40-4a66-4691-a043-586756a6c355 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:14.192386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852cb40-4a66-4691-a043-586756a6c355 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:14.192865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852cb40-4a66-4691-a043-586756a6c355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:14.210295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c852cb40-4a66-4691-a043-586756a6c355 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:14.211802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c852cb40-4a66-4691-a043-586756a6c355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:14.282364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 459/904] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:14.290336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff00a-af83-485d-bb31-3ae11e332a56 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:14.290630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff00a-af83-485d-bb31-3ae11e332a56 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:14.290912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ff00a-af83-485d-bb31-3ae11e332a56 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:14.293092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 446/905] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:14.298124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563fe77-f2d9-4854-925a-a2e35fde86b1 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:14.298461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563fe77-f2d9-4854-925a-a2e35fde86b1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:14.298742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563fe77-f2d9-4854-925a-a2e35fde86b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:14.305883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ff00a-af83-485d-bb31-3ae11e332a56 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:14.316833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-6563fe77-f2d9-4854-925a-a2e35fde86b1 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:14.318080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6563fe77-f2d9-4854-925a-a2e35fde86b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:14.402335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 460/906] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:14.419873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ff00a-af83-485d-bb31-3ae11e332a56 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:14.428083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563fe77-f2d9-4854-925a-a2e35fde86b1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:14.467486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d603d4-f77e-40eb-a8a1-7ffd68f8abc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:14.468571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d603d4-f77e-40eb-a8a1-7ffd68f8abc8 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:14.469055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d603d4-f77e-40eb-a8a1-7ffd68f8abc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:14.469554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d603d4-f77e-40eb-a8a1-7ffd68f8abc8 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:14.470514 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d603d4-f77e-40eb-a8a1-7ffd68f8abc8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:14.472091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d603d4-f77e-40eb-a8a1-7ffd68f8abc8 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:14.497764 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 447/907] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:13:14 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:14.543006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563fe77-f2d9-4854-925a-a2e35fde86b1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:14.590693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ea44-ba86-48f6-8479-a4dcaa83de16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:14.591519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ea44-ba86-48f6-8479-a4dcaa83de16 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:14.591797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ea44-ba86-48f6-8479-a4dcaa83de16 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:14.592072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912ea44-ba86-48f6-8479-a4dcaa83de16 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:14.592727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ea44-ba86-48f6-8479-a4dcaa83de16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:14.594091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912ea44-ba86-48f6-8479-a4dcaa83de16 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:14.606820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2912ea44-ba86-48f6-8479-a4dcaa83de16 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 00:13:14.608426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 461/908] 10.222.0.32 () {56 vars in 1132 bytes} [Tue Apr 12 00:13:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:14.614454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d603d4-f77e-40eb-a8a1-7ffd68f8abc8 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:14.732036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d603d4-f77e-40eb-a8a1-7ffd68f8abc8 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:14.766316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619239dd-a928-412b-ad39-659478efdda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:14.766997 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619239dd-a928-412b-ad39-659478efdda1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:14.767280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619239dd-a928-412b-ad39-659478efdda1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:14.767554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619239dd-a928-412b-ad39-659478efdda1 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:14.768313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619239dd-a928-412b-ad39-659478efdda1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:14.768621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619239dd-a928-412b-ad39-659478efdda1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:14.769975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619239dd-a928-412b-ad39-659478efdda1 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:14.774974 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 448/909] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:14.780696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ea44-ba86-48f6-8479-a4dcaa83de16 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:14.879254 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912ea44-ba86-48f6-8479-a4dcaa83de16 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:14.915872 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf9c0-498a-49b7-99a3-8ba4edfe44f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:14.917053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf9c0-498a-49b7-99a3-8ba4edfe44f4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:14.917331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf9c0-498a-49b7-99a3-8ba4edfe44f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:14.917649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cf9c0-498a-49b7-99a3-8ba4edfe44f4 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:14.918447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf9c0-498a-49b7-99a3-8ba4edfe44f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:14.918795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf9c0-498a-49b7-99a3-8ba4edfe44f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:14.920145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cf9c0-498a-49b7-99a3-8ba4edfe44f4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:14.925510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 462/910] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:14.931195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619239dd-a928-412b-ad39-659478efdda1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:15.035028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619239dd-a928-412b-ad39-659478efdda1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:15.068862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee6dc3-55c7-4c51-ae00-785af378acad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:15.069886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee6dc3-55c7-4c51-ae00-785af378acad None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:15.070408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee6dc3-55c7-4c51-ae00-785af378acad None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:15.070887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee6dc3-55c7-4c51-ae00-785af378acad None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:15.071875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee6dc3-55c7-4c51-ae00-785af378acad None admin] RBAC: Adding query filter params (interface=public, service_id=a40fd85da5f248ea8a586b6804517d9b, region_id=RegionOne) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:15.072980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee6dc3-55c7-4c51-ae00-785af378acad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:15.074594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee6dc3-55c7-4c51-ae00-785af378acad None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:15.080317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 449/911] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 00:13:14 2022] GET /identity/v3/endpoints?service_id=a40fd85da5f248ea8a586b6804517d9b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:15.085890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf9c0-498a-49b7-99a3-8ba4edfe44f4 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:15.186933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cf9c0-498a-49b7-99a3-8ba4edfe44f4 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:15.220501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c385f-1f13-4dcd-86d8-c658b5cb12a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:15.221156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c385f-1f13-4dcd-86d8-c658b5cb12a7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:15.221432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c385f-1f13-4dcd-86d8-c658b5cb12a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:15.221704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c385f-1f13-4dcd-86d8-c658b5cb12a7 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:15.222423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c385f-1f13-4dcd-86d8-c658b5cb12a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:15.223768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c385f-1f13-4dcd-86d8-c658b5cb12a7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:15.230734 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 463/912] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 00:13:15 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:15.402962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3972f9-f187-4c63-9059-fc7c097ab1eb None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:15.403954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3972f9-f187-4c63-9059-fc7c097ab1eb None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:15.404453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3972f9-f187-4c63-9059-fc7c097ab1eb None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:15.406344 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 450/913] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:15.411598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7b8b-80d2-4a1e-9b81-ddd5d0be616f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:15.412161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7b8b-80d2-4a1e-9b81-ddd5d0be616f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:15.412642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7b8b-80d2-4a1e-9b81-ddd5d0be616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:15.430679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e38c7b8b-80d2-4a1e-9b81-ddd5d0be616f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:15.432767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e38c7b8b-80d2-4a1e-9b81-ddd5d0be616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:15.504906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 464/914] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:15.527353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3972f9-f187-4c63-9059-fc7c097ab1eb None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:15.631855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3972f9-f187-4c63-9059-fc7c097ab1eb None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:15.671500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9cba0-43c5-438d-be05-f4996fdac577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:15.672329 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9cba0-43c5-438d-be05-f4996fdac577 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:15.672615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9cba0-43c5-438d-be05-f4996fdac577 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:15.672890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9cba0-43c5-438d-be05-f4996fdac577 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:15.684242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9cba0-43c5-438d-be05-f4996fdac577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:15.691556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-2db9cba0-43c5-438d-be05-f4996fdac577 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 00:13:15.693064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 451/915] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 00:13:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:15.698818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7b8b-80d2-4a1e-9b81-ddd5d0be616f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:15.799268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7b8b-80d2-4a1e-9b81-ddd5d0be616f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:15.832734 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69828068-b5a8-4cff-bf75-063bb53bfc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:15.833409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69828068-b5a8-4cff-bf75-063bb53bfc98 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:15.833688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69828068-b5a8-4cff-bf75-063bb53bfc98 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:15.833959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69828068-b5a8-4cff-bf75-063bb53bfc98 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:15.834725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69828068-b5a8-4cff-bf75-063bb53bfc98 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:15.835027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69828068-b5a8-4cff-bf75-063bb53bfc98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:15.836367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69828068-b5a8-4cff-bf75-063bb53bfc98 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:15.845393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 465/916] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 00:13:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:15.852338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9cba0-43c5-438d-be05-f4996fdac577 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:15.884293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3673d3-91ee-41e3-b3c6-135156426d3d None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:15.884579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3673d3-91ee-41e3-b3c6-135156426d3d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:15.884876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3673d3-91ee-41e3-b3c6-135156426d3d None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:15.886420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 466/917] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:15.892194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec8278-4523-4583-8d26-9c4d97d63646 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:15.892475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec8278-4523-4583-8d26-9c4d97d63646 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:15.892748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec8278-4523-4583-8d26-9c4d97d63646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:15.909352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-64ec8278-4523-4583-8d26-9c4d97d63646 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:15.910559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-64ec8278-4523-4583-8d26-9c4d97d63646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:15.964531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9cba0-43c5-438d-be05-f4996fdac577 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:15.986286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 467/918] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:16.007197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2eba5-6d88-459b-9300-504b8183dda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.009024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec8278-4523-4583-8d26-9c4d97d63646 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:16.009672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2eba5-6d88-459b-9300-504b8183dda6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.010037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2eba5-6d88-459b-9300-504b8183dda6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.010385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2eba5-6d88-459b-9300-504b8183dda6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.021085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2eba5-6d88-459b-9300-504b8183dda6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.022584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2eba5-6d88-459b-9300-504b8183dda6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.040226 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-1ec2eba5-6d88-459b-9300-504b8183dda6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:16.042376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 452/919] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:16.050385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2eba5-6d88-459b-9300-504b8183dda6 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:16.113204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec8278-4523-4583-8d26-9c4d97d63646 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:16.147531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff51e9-9c4b-4db7-86c3-43b359bfc701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.148094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff51e9-9c4b-4db7-86c3-43b359bfc701 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.148374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff51e9-9c4b-4db7-86c3-43b359bfc701 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.148645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff51e9-9c4b-4db7-86c3-43b359bfc701 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.149284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff51e9-9c4b-4db7-86c3-43b359bfc701 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.151179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff51e9-9c4b-4db7-86c3-43b359bfc701 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.155291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2eba5-6d88-459b-9300-504b8183dda6 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:16.162169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-3eff51e9-9c4b-4db7-86c3-43b359bfc701 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 12 00:13:16.169096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 468/920] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:13:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:16.171298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff51e9-9c4b-4db7-86c3-43b359bfc701 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:16.197107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb7de1-984b-475e-91af-f718f27fa92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.197971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb7de1-984b-475e-91af-f718f27fa92b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.198377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb7de1-984b-475e-91af-f718f27fa92b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.198745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb7de1-984b-475e-91af-f718f27fa92b None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.199979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb7de1-984b-475e-91af-f718f27fa92b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:16.200381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb7de1-984b-475e-91af-f718f27fa92b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.202207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb7de1-984b-475e-91af-f718f27fa92b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.222726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 453/921] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:16.223711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb7de1-984b-475e-91af-f718f27fa92b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:16.284684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff51e9-9c4b-4db7-86c3-43b359bfc701 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:16.322955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4738f-a264-4b5a-9a24-d949449e189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.324612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4738f-a264-4b5a-9a24-d949449e189f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.325155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4738f-a264-4b5a-9a24-d949449e189f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.325613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4738f-a264-4b5a-9a24-d949449e189f None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.326697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4738f-a264-4b5a-9a24-d949449e189f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:16.327507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4738f-a264-4b5a-9a24-d949449e189f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.329511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4738f-a264-4b5a-9a24-d949449e189f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.341320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 469/922] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:13:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:16.343003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4738f-a264-4b5a-9a24-d949449e189f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:16.349655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb7de1-984b-475e-91af-f718f27fa92b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:16.384257 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803671b-387c-4684-95ac-d8f6aa1982e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.385590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803671b-387c-4684-95ac-d8f6aa1982e3 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.385972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803671b-387c-4684-95ac-d8f6aa1982e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.386378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803671b-387c-4684-95ac-d8f6aa1982e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.394626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803671b-387c-4684-95ac-d8f6aa1982e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.396370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803671b-387c-4684-95ac-d8f6aa1982e3 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.411839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-1803671b-387c-4684-95ac-d8f6aa1982e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 00:13:16.418342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 454/923] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:13:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:16.419321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803671b-387c-4684-95ac-d8f6aa1982e3 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:16.475566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4738f-a264-4b5a-9a24-d949449e189f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:16.516782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803671b-387c-4684-95ac-d8f6aa1982e3 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:16.518438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4d76-905e-4022-b286-8b19ba93979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.519576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4d76-905e-4022-b286-8b19ba93979e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.520944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4d76-905e-4022-b286-8b19ba93979e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.521394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba4d76-905e-4022-b286-8b19ba93979e None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.522318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba4d76-905e-4022-b286-8b19ba93979e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:16.522783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba4d76-905e-4022-b286-8b19ba93979e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.524369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba4d76-905e-4022-b286-8b19ba93979e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.537700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 470/924] 10.222.0.32 () {56 vars in 1114 bytes} [Tue Apr 12 00:13:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:16.538806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4d76-905e-4022-b286-8b19ba93979e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:16.566580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909889e7-3237-4085-bac8-fd4a2f62ee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.568032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909889e7-3237-4085-bac8-fd4a2f62ee63 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.568509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909889e7-3237-4085-bac8-fd4a2f62ee63 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.569208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909889e7-3237-4085-bac8-fd4a2f62ee63 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.570406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909889e7-3237-4085-bac8-fd4a2f62ee63 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:16.570900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909889e7-3237-4085-bac8-fd4a2f62ee63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.573174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909889e7-3237-4085-bac8-fd4a2f62ee63 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.600153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 455/925] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 00:13:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:16.600977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909889e7-3237-4085-bac8-fd4a2f62ee63 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:16.653251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba4d76-905e-4022-b286-8b19ba93979e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:16.691473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a699140-c2fb-4955-92c2-2d6029c4fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.692490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a699140-c2fb-4955-92c2-2d6029c4fc47 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.692981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a699140-c2fb-4955-92c2-2d6029c4fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.693478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a699140-c2fb-4955-92c2-2d6029c4fc47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.694451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a699140-c2fb-4955-92c2-2d6029c4fc47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.696014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a699140-c2fb-4955-92c2-2d6029c4fc47 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.699443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909889e7-3237-4085-bac8-fd4a2f62ee63 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:16.722566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 471/926] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 00:13:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:13:16.743098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639bc8e-4120-412b-aa58-235b9e28df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.743827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639bc8e-4120-412b-aa58-235b9e28df30 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.744106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639bc8e-4120-412b-aa58-235b9e28df30 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.744933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639bc8e-4120-412b-aa58-235b9e28df30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.756577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639bc8e-4120-412b-aa58-235b9e28df30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.758052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639bc8e-4120-412b-aa58-235b9e28df30 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.776754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-9639bc8e-4120-412b-aa58-235b9e28df30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:16.778379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 456/927] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:16.787490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a699140-c2fb-4955-92c2-2d6029c4fc47 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:16.901753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a699140-c2fb-4955-92c2-2d6029c4fc47 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:16.908315 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfe6e5-6309-466b-8a52-75b2c5f35270 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.908601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfe6e5-6309-466b-8a52-75b2c5f35270 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.908870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfe6e5-6309-466b-8a52-75b2c5f35270 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.911643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 457/928] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:16.916724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9f32b-ab34-4ce2-b027-533ff6994ee5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.916984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9f32b-ab34-4ce2-b027-533ff6994ee5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.917264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9f32b-ab34-4ce2-b027-533ff6994ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.937131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-97a9f32b-ab34-4ce2-b027-533ff6994ee5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:16.938374 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-97a9f32b-ab34-4ce2-b027-533ff6994ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:16.939399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a8075-f3af-42cc-b477-d9f535284dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:16.940072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a8075-f3af-42cc-b477-d9f535284dfd None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:16.940356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a8075-f3af-42cc-b477-d9f535284dfd None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:16.940640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a8075-f3af-42cc-b477-d9f535284dfd None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:16.941369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a8075-f3af-42cc-b477-d9f535284dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:16.941674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a8075-f3af-42cc-b477-d9f535284dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:16.943144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a8075-f3af-42cc-b477-d9f535284dfd None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:16.957659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 472/929] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:16.963642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a8075-f3af-42cc-b477-d9f535284dfd None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.026354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 458/930] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:17.046622 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9f32b-ab34-4ce2-b027-533ff6994ee5 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.072321 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a8075-f3af-42cc-b477-d9f535284dfd None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:17.106704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe0339-f33f-45e3-82a2-d96c2c46ffba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:17.107937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe0339-f33f-45e3-82a2-d96c2c46ffba None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.108452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe0339-f33f-45e3-82a2-d96c2c46ffba None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.108920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe0339-f33f-45e3-82a2-d96c2c46ffba None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.116174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe0339-f33f-45e3-82a2-d96c2c46ffba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:17.117830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe0339-f33f-45e3-82a2-d96c2c46ffba None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:17.131071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-9cfe0339-f33f-45e3-82a2-d96c2c46ffba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:17.132959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 473/931] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:17.139371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe0339-f33f-45e3-82a2-d96c2c46ffba None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.158432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9f32b-ab34-4ce2-b027-533ff6994ee5 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:17.199560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20aa1-9023-471b-81b9-4ac98172bc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:17.200397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20aa1-9023-471b-81b9-4ac98172bc27 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.200674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20aa1-9023-471b-81b9-4ac98172bc27 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.200940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed20aa1-9023-471b-81b9-4ac98172bc27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.201671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20aa1-9023-471b-81b9-4ac98172bc27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:17.204022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed20aa1-9023-471b-81b9-4ac98172bc27 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:17.220469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-fed20aa1-9023-471b-81b9-4ac98172bc27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 00:13:17.227096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 459/932] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:17.229446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20aa1-9023-471b-81b9-4ac98172bc27 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.260353 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe0339-f33f-45e3-82a2-d96c2c46ffba None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:17.295503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb9a6-d967-4a81-9660-3b425f1e81df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:17.296110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb9a6-d967-4a81-9660-3b425f1e81df None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.296334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb9a6-d967-4a81-9660-3b425f1e81df None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.296580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb9a6-d967-4a81-9660-3b425f1e81df None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.297350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb9a6-d967-4a81-9660-3b425f1e81df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:17.297651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb9a6-d967-4a81-9660-3b425f1e81df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:17.299196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb9a6-d967-4a81-9660-3b425f1e81df None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:17.312250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 474/933] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:17.318061 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb9a6-d967-4a81-9660-3b425f1e81df None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.360884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed20aa1-9023-471b-81b9-4ac98172bc27 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:17.402437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bad65-323d-4ad7-9d27-9b1a33a94fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:17.403833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bad65-323d-4ad7-9d27-9b1a33a94fee None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.404497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bad65-323d-4ad7-9d27-9b1a33a94fee None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.405056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bad65-323d-4ad7-9d27-9b1a33a94fee None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.406096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bad65-323d-4ad7-9d27-9b1a33a94fee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:17.406983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bad65-323d-4ad7-9d27-9b1a33a94fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:17.408941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bad65-323d-4ad7-9d27-9b1a33a94fee None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:17.420489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb9a6-d967-4a81-9660-3b425f1e81df None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:17.420657 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 460/934] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:17.423547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bad65-323d-4ad7-9d27-9b1a33a94fee None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.459149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4db9b2-6976-4e4e-b109-0633cfa85eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:17.460890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4db9b2-6976-4e4e-b109-0633cfa85eb3 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.461337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4db9b2-6976-4e4e-b109-0633cfa85eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.461768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4db9b2-6976-4e4e-b109-0633cfa85eb3 None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/085b8de5c190423bb7ba5da5993479f0/roles/ed1b3a4e24f2471288b84816ceb586c6` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.464980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4db9b2-6976-4e4e-b109-0633cfa85eb3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=085b8de5c190423bb7ba5da5993479f0, role_id=ed1b3a4e24f2471288b84816ceb586c6)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:17.467515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4db9b2-6976-4e4e-b109-0633cfa85eb3 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:17.484823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 475/935] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:13:17 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/085b8de5c190423bb7ba5da5993479f0/roles/ed1b3a4e24f2471288b84816ceb586c6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:17.556415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bad65-323d-4ad7-9d27-9b1a33a94fee None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:17.592112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f047f9d-24a6-4ba8-9c77-d2dadf46facb None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.592436 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f047f9d-24a6-4ba8-9c77-d2dadf46facb None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.592662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f047f9d-24a6-4ba8-9c77-d2dadf46facb None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.594298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 476/936] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:17.600034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b61ff-2545-4207-bdc5-3842102d8ca3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.600653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b61ff-2545-4207-bdc5-3842102d8ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.601133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b61ff-2545-4207-bdc5-3842102d8ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.602145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc079afc-fc14-4118-9c8b-1993553acb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:17.602984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc079afc-fc14-4118-9c8b-1993553acb8c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.603397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc079afc-fc14-4118-9c8b-1993553acb8c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.603779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc079afc-fc14-4118-9c8b-1993553acb8c None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.604591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc079afc-fc14-4118-9c8b-1993553acb8c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:17.604896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc079afc-fc14-4118-9c8b-1993553acb8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:17.608037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc079afc-fc14-4118-9c8b-1993553acb8c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:17.618357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 461/937] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:17.620550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc079afc-fc14-4118-9c8b-1993553acb8c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.623630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-795b61ff-2545-4207-bdc5-3842102d8ca3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:17.624959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-795b61ff-2545-4207-bdc5-3842102d8ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:17.710412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 477/938] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:17.735026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b61ff-2545-4207-bdc5-3842102d8ca3 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.743156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc079afc-fc14-4118-9c8b-1993553acb8c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:17.777974 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afa42e-1452-431a-a4cb-6cd927471ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:17.779093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afa42e-1452-431a-a4cb-6cd927471ffe None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.779620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afa42e-1452-431a-a4cb-6cd927471ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.780089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afa42e-1452-431a-a4cb-6cd927471ffe None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.781522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afa42e-1452-431a-a4cb-6cd927471ffe None admin] RBAC: Adding query filter params (interface=public, service_id=d321889d6a09482990b037cdd2638146, region_id=RegionOne) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:17.782031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afa42e-1452-431a-a4cb-6cd927471ffe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:17.784305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afa42e-1452-431a-a4cb-6cd927471ffe None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:17.791929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 462/939] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 00:13:17 2022] GET /identity/v3/endpoints?service_id=d321889d6a09482990b037cdd2638146&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:17.802300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afa42e-1452-431a-a4cb-6cd927471ffe None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.843577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b61ff-2545-4207-bdc5-3842102d8ca3 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:17.878377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a8567-089f-4447-a9fb-198badf38f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:17.879198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a8567-089f-4447-a9fb-198badf38f27 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.879485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a8567-089f-4447-a9fb-198badf38f27 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.879762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a8567-089f-4447-a9fb-198badf38f27 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.880413 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a8567-089f-4447-a9fb-198badf38f27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:17.881768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a8567-089f-4447-a9fb-198badf38f27 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:17.893809 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-662a8567-089f-4447-a9fb-198badf38f27 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 12 00:13:17.895390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 478/940] 10.222.0.32 () {56 vars in 1132 bytes} [Tue Apr 12 00:13:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:17.902516 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a8567-089f-4447-a9fb-198badf38f27 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:17.903102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afa42e-1452-431a-a4cb-6cd927471ffe None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:17.937813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65a257-bee7-49d7-9add-da233ece3e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:17.938671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a257-bee7-49d7-9add-da233ece3e98 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:17.939064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a257-bee7-49d7-9add-da233ece3e98 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:17.939409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a257-bee7-49d7-9add-da233ece3e98 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:17.940182 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65a257-bee7-49d7-9add-da233ece3e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:17.941727 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65a257-bee7-49d7-9add-da233ece3e98 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:17.954363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 463/941] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 00:13:17 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:13:18.020912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a8567-089f-4447-a9fb-198badf38f27 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:18.057524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d764e-f2cf-49e3-b19f-512a891bb2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:18.058211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d764e-f2cf-49e3-b19f-512a891bb2f7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:18.058539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d764e-f2cf-49e3-b19f-512a891bb2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:18.058813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d764e-f2cf-49e3-b19f-512a891bb2f7 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:18.059530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d764e-f2cf-49e3-b19f-512a891bb2f7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:18.059834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d764e-f2cf-49e3-b19f-512a891bb2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:18.061216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d764e-f2cf-49e3-b19f-512a891bb2f7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:18.067036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 479/942] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:18.073018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65a257-bee7-49d7-9add-da233ece3e98 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:18.178887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65a257-bee7-49d7-9add-da233ece3e98 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:18.212216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ebef-42ae-43b8-95ee-0465c60454e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:18.212935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ebef-42ae-43b8-95ee-0465c60454e0 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:18.213711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ebef-42ae-43b8-95ee-0465c60454e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:18.213987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ebef-42ae-43b8-95ee-0465c60454e0 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:18.214715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433ebef-42ae-43b8-95ee-0465c60454e0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:18.215018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433ebef-42ae-43b8-95ee-0465c60454e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:18.216382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433ebef-42ae-43b8-95ee-0465c60454e0 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:18.221643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 464/943] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:18.226932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d764e-f2cf-49e3-b19f-512a891bb2f7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:18.326059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d764e-f2cf-49e3-b19f-512a891bb2f7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:18.359901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501e2fc-758b-4b51-a2bc-584b38cbd95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:18.360573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501e2fc-758b-4b51-a2bc-584b38cbd95e None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:18.360855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501e2fc-758b-4b51-a2bc-584b38cbd95e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:18.361130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501e2fc-758b-4b51-a2bc-584b38cbd95e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:18.361882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501e2fc-758b-4b51-a2bc-584b38cbd95e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:18.363277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501e2fc-758b-4b51-a2bc-584b38cbd95e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:18.383932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 480/944] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 00:13:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:13:19.152214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724ac5-46b8-4724-aa0e-f6708d9c5b2f None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:19.152732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724ac5-46b8-4724-aa0e-f6708d9c5b2f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:19.152809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d724ac5-46b8-4724-aa0e-f6708d9c5b2f None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:19.154412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 465/945] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:19.159879 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10ec7-e142-4a7c-9ecb-f3c533e9c984 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:19.160178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10ec7-e142-4a7c-9ecb-f3c533e9c984 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:19.160463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10ec7-e142-4a7c-9ecb-f3c533e9c984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:19.178786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ccf10ec7-e142-4a7c-9ecb-f3c533e9c984 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:19.179966 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ccf10ec7-e142-4a7c-9ecb-f3c533e9c984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:19.251819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 481/946] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:19.277102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d724ac5-46b8-4724-aa0e-f6708d9c5b2f None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:19.382641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d724ac5-46b8-4724-aa0e-f6708d9c5b2f None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:19.415708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:19.416860 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:19.417141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:19.417416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:19.418125 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:19.419569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:19.420915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.common [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 12 00:13:19.440833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.sql.core [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 12 00:13:19.440833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 12 00:13:19.440833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [parameters: {'id': '4f0219298e6442c8a4d211b350b97d6f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 12 00:13:19.440833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86099) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 00:13:19.447272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4f0219298e6442c8a4d211b350b97d6f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4f0219298e6442c8a4d211b350b97d6f. Apr 12 00:13:19.448878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 466/947] 10.222.0.32 () {60 vars in 1140 bytes} [Tue Apr 12 00:13:19 2022] POST /identity/v3/projects => generated 262 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:19.454401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf10ec7-e142-4a7c-9ecb-f3c533e9c984 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:19.559444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf10ec7-e142-4a7c-9ecb-f3c533e9c984 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:19.595597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910590ad-2b5c-4b64-8ff9-2d3ac22fda9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:19.596407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910590ad-2b5c-4b64-8ff9-2d3ac22fda9a None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:19.596692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910590ad-2b5c-4b64-8ff9-2d3ac22fda9a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:19.596969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910590ad-2b5c-4b64-8ff9-2d3ac22fda9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:19.604565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910590ad-2b5c-4b64-8ff9-2d3ac22fda9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:19.606013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910590ad-2b5c-4b64-8ff9-2d3ac22fda9a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:19.619700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-910590ad-2b5c-4b64-8ff9-2d3ac22fda9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:19.621253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 482/948] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:19.627199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:19.740279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2fc92-5792-428f-88d4-158ef7e375c0 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:19.773967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8cfaf-ba10-45cf-9c60-e09d7819a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:19.774660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8cfaf-ba10-45cf-9c60-e09d7819a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:19.774943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8cfaf-ba10-45cf-9c60-e09d7819a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:19.775769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8cfaf-ba10-45cf-9c60-e09d7819a3f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:19.776533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8cfaf-ba10-45cf-9c60-e09d7819a3f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:19.776842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8cfaf-ba10-45cf-9c60-e09d7819a3f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:19.778516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8cfaf-ba10-45cf-9c60-e09d7819a3f6 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:19.799735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 467/949] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:19.937074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24d98c-70f7-494e-9b67-aec71108a986 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:19.937545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24d98c-70f7-494e-9b67-aec71108a986 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:19.937924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24d98c-70f7-494e-9b67-aec71108a986 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:19.939787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 483/950] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:19.945658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e76bf-1989-4bd0-9e1b-c123387af46d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:19.946037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e76bf-1989-4bd0-9e1b-c123387af46d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:19.946431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e76bf-1989-4bd0-9e1b-c123387af46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:19.966782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-be9e76bf-1989-4bd0-9e1b-c123387af46d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:19.968414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-be9e76bf-1989-4bd0-9e1b-c123387af46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:20.040002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 468/951] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:20.065261 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24d98c-70f7-494e-9b67-aec71108a986 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:20.175862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24d98c-70f7-494e-9b67-aec71108a986 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:20.210504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db27ed1-b7ee-4e3b-9753-4d94aa7ff65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:20.211662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27ed1-b7ee-4e3b-9753-4d94aa7ff65b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.212155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27ed1-b7ee-4e3b-9753-4d94aa7ff65b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.212647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27ed1-b7ee-4e3b-9753-4d94aa7ff65b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.224482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db27ed1-b7ee-4e3b-9753-4d94aa7ff65b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:20.232333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2db27ed1-b7ee-4e3b-9753-4d94aa7ff65b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 00:13:20.234119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 484/952] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 00:13:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:20.239713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e76bf-1989-4bd0-9e1b-c123387af46d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:20.339816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc028-140f-416e-a2ca-e45d24cc450c None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.340674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc028-140f-416e-a2ca-e45d24cc450c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.341178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33dc028-140f-416e-a2ca-e45d24cc450c None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.342198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e76bf-1989-4bd0-9e1b-c123387af46d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:20.343300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 485/953] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:20.348609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3d4ad-226a-4a18-83cc-40166e31ad7e None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.349161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3d4ad-226a-4a18-83cc-40166e31ad7e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.349645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3d4ad-226a-4a18-83cc-40166e31ad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.366418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f9b3d4ad-226a-4a18-83cc-40166e31ad7e None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:20.367932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f9b3d4ad-226a-4a18-83cc-40166e31ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:20.378607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfb256-19aa-4f46-80ee-f5e674a26eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:20.379269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfb256-19aa-4f46-80ee-f5e674a26eaf None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.379548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfb256-19aa-4f46-80ee-f5e674a26eaf None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.379820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfb256-19aa-4f46-80ee-f5e674a26eaf None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.380563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfb256-19aa-4f46-80ee-f5e674a26eaf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:20.381072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfb256-19aa-4f46-80ee-f5e674a26eaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:20.382290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfb256-19aa-4f46-80ee-f5e674a26eaf None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:20.391107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 469/954] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 00:13:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:20.396950 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfb256-19aa-4f46-80ee-f5e674a26eaf None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:20.454220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 486/955] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:20.478299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3d4ad-226a-4a18-83cc-40166e31ad7e None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:20.519388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfb256-19aa-4f46-80ee-f5e674a26eaf None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:20.561847 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacfc63-8d6c-4c9a-916d-dc58bce46c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:20.563035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacfc63-8d6c-4c9a-916d-dc58bce46c8c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.563323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacfc63-8d6c-4c9a-916d-dc58bce46c8c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.563598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacfc63-8d6c-4c9a-916d-dc58bce46c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.581644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacfc63-8d6c-4c9a-916d-dc58bce46c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:20.582830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3d4ad-226a-4a18-83cc-40166e31ad7e None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:20.583648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacfc63-8d6c-4c9a-916d-dc58bce46c8c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:20.605994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-aaacfc63-8d6c-4c9a-916d-dc58bce46c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:20.608456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 470/956] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:20.613660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacfc63-8d6c-4c9a-916d-dc58bce46c8c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:20.624679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b73cf1-1477-4f32-b2fe-40117aeab33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:20.625491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b73cf1-1477-4f32-b2fe-40117aeab33f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.626126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b73cf1-1477-4f32-b2fe-40117aeab33f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.626517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b73cf1-1477-4f32-b2fe-40117aeab33f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.627175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b73cf1-1477-4f32-b2fe-40117aeab33f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:20.629193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b73cf1-1477-4f32-b2fe-40117aeab33f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:20.643479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-27b73cf1-1477-4f32-b2fe-40117aeab33f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 00:13:20.645587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 487/957] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:20.652214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b73cf1-1477-4f32-b2fe-40117aeab33f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:20.734345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacfc63-8d6c-4c9a-916d-dc58bce46c8c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:20.776075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18866-0083-49cf-a3a3-19232ab68348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:20.776790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18866-0083-49cf-a3a3-19232ab68348 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.777140 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18866-0083-49cf-a3a3-19232ab68348 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.777475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18866-0083-49cf-a3a3-19232ab68348 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.778282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef18866-0083-49cf-a3a3-19232ab68348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:20.778659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef18866-0083-49cf-a3a3-19232ab68348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:20.779501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b73cf1-1477-4f32-b2fe-40117aeab33f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:20.780152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef18866-0083-49cf-a3a3-19232ab68348 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:20.796941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 471/958] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:20.797967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18866-0083-49cf-a3a3-19232ab68348 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:20.819490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526f953-d650-4f07-93f1-549d49275630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:20.820157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526f953-d650-4f07-93f1-549d49275630 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.820441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526f953-d650-4f07-93f1-549d49275630 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.820714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526f953-d650-4f07-93f1-549d49275630 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.821411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526f953-d650-4f07-93f1-549d49275630 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:20.821727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526f953-d650-4f07-93f1-549d49275630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:20.823650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6526f953-d650-4f07-93f1-549d49275630 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:20.832674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 488/959] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:20.832674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932e4d-a1f1-436d-9345-75a49e6f1b18 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.832674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932e4d-a1f1-436d-9345-75a49e6f1b18 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.832674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69932e4d-a1f1-436d-9345-75a49e6f1b18 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.832674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 489/960] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:20.836390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69932e4d-a1f1-436d-9345-75a49e6f1b18 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:20.901791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18866-0083-49cf-a3a3-19232ab68348 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:20.935877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6856d0d-323e-4dd7-9d91-8256a127ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:20.936685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6856d0d-323e-4dd7-9d91-8256a127ebcf None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.936967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6856d0d-323e-4dd7-9d91-8256a127ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.937243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6856d0d-323e-4dd7-9d91-8256a127ebcf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.944240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6856d0d-323e-4dd7-9d91-8256a127ebcf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:20.944944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69932e4d-a1f1-436d-9345-75a49e6f1b18 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:20.945686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6856d0d-323e-4dd7-9d91-8256a127ebcf None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:20.959889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-b6856d0d-323e-4dd7-9d91-8256a127ebcf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 12 00:13:20.961108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 472/961] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:13:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:20.962388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ab2a6-6189-4982-bdae-904e4c39de97 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.962711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ab2a6-6189-4982-bdae-904e4c39de97 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.963003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ab2a6-6189-4982-bdae-904e4c39de97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.980147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-f04ab2a6-6189-4982-bdae-904e4c39de97 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:20.981328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f04ab2a6-6189-4982-bdae-904e4c39de97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:20.984216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15333b70-68f1-4665-a38a-26039833c2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:20.984936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333b70-68f1-4665-a38a-26039833c2fa None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:20.985160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333b70-68f1-4665-a38a-26039833c2fa None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:20.985433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15333b70-68f1-4665-a38a-26039833c2fa None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:20.986123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15333b70-68f1-4665-a38a-26039833c2fa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:20.986451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15333b70-68f1-4665-a38a-26039833c2fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:20.987791 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15333b70-68f1-4665-a38a-26039833c2fa None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:20.992414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 490/962] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:20.993184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15333b70-68f1-4665-a38a-26039833c2fa None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:21.062795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 473/963] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:21.064122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ab2a6-6189-4982-bdae-904e4c39de97 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:21.095452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15333b70-68f1-4665-a38a-26039833c2fa None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:21.128322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8b4b1-0aa0-491a-8458-8db30a3ec656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:21.128989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8b4b1-0aa0-491a-8458-8db30a3ec656 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:21.129265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8b4b1-0aa0-491a-8458-8db30a3ec656 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:21.129539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8b4b1-0aa0-491a-8458-8db30a3ec656 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:21.130394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8b4b1-0aa0-491a-8458-8db30a3ec656 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:21.130701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8b4b1-0aa0-491a-8458-8db30a3ec656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:21.132117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8b4b1-0aa0-491a-8458-8db30a3ec656 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:21.148474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 491/964] 10.222.0.32 () {56 vars in 1149 bytes} [Tue Apr 12 00:13:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:21.149318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8b4b1-0aa0-491a-8458-8db30a3ec656 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:21.170203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ab2a6-6189-4982-bdae-904e4c39de97 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:21.203763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a10cfe-c2cc-457a-8065-f0ef634a3386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:21.204413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a10cfe-c2cc-457a-8065-f0ef634a3386 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:21.204691 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a10cfe-c2cc-457a-8065-f0ef634a3386 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:21.204961 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a10cfe-c2cc-457a-8065-f0ef634a3386 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:21.205680 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a10cfe-c2cc-457a-8065-f0ef634a3386 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:21.207067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a10cfe-c2cc-457a-8065-f0ef634a3386 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:21.228233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 474/965] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 00:13:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:21.229626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a10cfe-c2cc-457a-8065-f0ef634a3386 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:21.243387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8b4b1-0aa0-491a-8458-8db30a3ec656 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:21.287830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988afbd4-0c74-48ab-8d2c-509b670d42fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:21.289285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988afbd4-0c74-48ab-8d2c-509b670d42fc None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:21.289769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988afbd4-0c74-48ab-8d2c-509b670d42fc None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:21.290308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988afbd4-0c74-48ab-8d2c-509b670d42fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:21.291979 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988afbd4-0c74-48ab-8d2c-509b670d42fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:21.293675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988afbd4-0c74-48ab-8d2c-509b670d42fc None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:21.306026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-988afbd4-0c74-48ab-8d2c-509b670d42fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 00:13:21.307720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 492/966] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:21.315376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988afbd4-0c74-48ab-8d2c-509b670d42fc None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:21.358184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a10cfe-c2cc-457a-8065-f0ef634a3386 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:21.393806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86e40d-e589-4da0-945c-789e24ed3c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:21.394496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86e40d-e589-4da0-945c-789e24ed3c2c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:21.394776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86e40d-e589-4da0-945c-789e24ed3c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:21.395047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86e40d-e589-4da0-945c-789e24ed3c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:21.425211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988afbd4-0c74-48ab-8d2c-509b670d42fc None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:21.464670 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83113b-92f0-4574-9e00-57f5038c95ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:21.465370 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83113b-92f0-4574-9e00-57f5038c95ee None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:21.465653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83113b-92f0-4574-9e00-57f5038c95ee None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:21.466562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83113b-92f0-4574-9e00-57f5038c95ee None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:21.466683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83113b-92f0-4574-9e00-57f5038c95ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:21.466936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83113b-92f0-4574-9e00-57f5038c95ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:21.468287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83113b-92f0-4574-9e00-57f5038c95ee None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:21.472870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86e40d-e589-4da0-945c-789e24ed3c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:21.474346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86e40d-e589-4da0-945c-789e24ed3c2c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:21.477854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 493/967] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:21.484789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83113b-92f0-4574-9e00-57f5038c95ee None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:21.579568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 475/968] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:21 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:13:21.580785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86e40d-e589-4da0-945c-789e24ed3c2c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:21.584451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83113b-92f0-4574-9e00-57f5038c95ee None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:21.617833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ade2b7-7ae0-43db-9b98-c1115e24b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:21.618905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade2b7-7ae0-43db-9b98-c1115e24b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:21.619421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade2b7-7ae0-43db-9b98-c1115e24b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:21.619891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade2b7-7ae0-43db-9b98-c1115e24b0d0 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:21.620783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ade2b7-7ae0-43db-9b98-c1115e24b0d0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:21.621305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ade2b7-7ae0-43db-9b98-c1115e24b0d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:21.622893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ade2b7-7ae0-43db-9b98-c1115e24b0d0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:21.627980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 494/969] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:21.684554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86e40d-e589-4da0-945c-789e24ed3c2c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:21.722107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d9e38-f222-417f-9386-2f53da72106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:21.722966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d9e38-f222-417f-9386-2f53da72106d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:21.723250 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d9e38-f222-417f-9386-2f53da72106d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:21.723524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d9e38-f222-417f-9386-2f53da72106d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:21.735417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d9e38-f222-417f-9386-2f53da72106d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:21.736907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d9e38-f222-417f-9386-2f53da72106d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:21.755439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-867d9e38-f222-417f-9386-2f53da72106d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:21.761098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 476/970] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:21.763479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ade2b7-7ae0-43db-9b98-c1115e24b0d0 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:21.872573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ade2b7-7ae0-43db-9b98-c1115e24b0d0 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:21.908590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43077f39-90ee-404a-b367-30d5208ca46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:21.909617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43077f39-90ee-404a-b367-30d5208ca46a None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:21.910154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43077f39-90ee-404a-b367-30d5208ca46a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:21.910641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43077f39-90ee-404a-b367-30d5208ca46a None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:21.911544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43077f39-90ee-404a-b367-30d5208ca46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:21.912065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43077f39-90ee-404a-b367-30d5208ca46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:21.913906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43077f39-90ee-404a-b367-30d5208ca46a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:21.926104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 495/971] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:21.934328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d9e38-f222-417f-9386-2f53da72106d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:22.038609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d9e38-f222-417f-9386-2f53da72106d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:22.077511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420df320-a3cd-480a-b087-6d7840b7298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:22.078588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df320-a3cd-480a-b087-6d7840b7298c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:22.079018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df320-a3cd-480a-b087-6d7840b7298c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:22.079435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420df320-a3cd-480a-b087-6d7840b7298c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:22.086674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420df320-a3cd-480a-b087-6d7840b7298c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:22.088849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420df320-a3cd-480a-b087-6d7840b7298c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:22.101894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-420df320-a3cd-480a-b087-6d7840b7298c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:22.108286 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 477/972] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:22.109768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43077f39-90ee-404a-b367-30d5208ca46a None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:22.207938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43077f39-90ee-404a-b367-30d5208ca46a None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:22.241458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f7da0-579b-46f9-a032-62b866b5dc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:22.242389 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f7da0-579b-46f9-a032-62b866b5dc8d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:22.242881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f7da0-579b-46f9-a032-62b866b5dc8d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:22.245177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0faee2-bfb4-4fb5-bc3d-179f372e2814 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:22.245633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0faee2-bfb4-4fb5-bc3d-179f372e2814 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:22.246067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0faee2-bfb4-4fb5-bc3d-179f372e2814 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:22.246523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f7da0-579b-46f9-a032-62b866b5dc8d None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:22.247364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f7da0-579b-46f9-a032-62b866b5dc8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:22.247679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f7da0-579b-46f9-a032-62b866b5dc8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:22.248613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 478/973] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:22.249105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f7da0-579b-46f9-a032-62b866b5dc8d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:22.255510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a38867-c967-41d5-8d14-b7011a0e0f77 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:22.256044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a38867-c967-41d5-8d14-b7011a0e0f77 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:22.256520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a38867-c967-41d5-8d14-b7011a0e0f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:22.262299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 496/974] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:22.267719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f7da0-579b-46f9-a032-62b866b5dc8d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:22.276325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-20a38867-c967-41d5-8d14-b7011a0e0f77 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:22.277514 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-20a38867-c967-41d5-8d14-b7011a0e0f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:22.346304 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 479/975] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:22.372107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a38867-c967-41d5-8d14-b7011a0e0f77 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:22.383449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f7da0-579b-46f9-a032-62b866b5dc8d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:22.429865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1bba8-e6d4-4056-b616-346f01d4eaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:22.431043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1bba8-e6d4-4056-b616-346f01d4eaab None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:22.431590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1bba8-e6d4-4056-b616-346f01d4eaab None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:22.432071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1bba8-e6d4-4056-b616-346f01d4eaab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:22.433104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1bba8-e6d4-4056-b616-346f01d4eaab None admin] RBAC: Adding query filter params (role.id=ed1b3a4e24f2471288b84816ceb586c6, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=085b8de5c190423bb7ba5da5993479f0) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:22.433621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1bba8-e6d4-4056-b616-346f01d4eaab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:22.435260 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1bba8-e6d4-4056-b616-346f01d4eaab None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:22.450393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 497/976] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:22 2022] GET /identity/v3/role_assignments?user.id=085b8de5c190423bb7ba5da5993479f0&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=ed1b3a4e24f2471288b84816ceb586c6 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:22.474473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a38867-c967-41d5-8d14-b7011a0e0f77 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:22.512318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:22.513016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:22.513294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:22.513562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:22.514303 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:22.515762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:22.530591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.sql.core [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 12 00:13:22.530591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 12 00:13:22.530591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [parameters: {'user_id': 'f8e7858a97504f05b10c1ed4ea6edefb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 12 00:13:22.530591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86099) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 12 00:13:22.536713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 12 00:13:22.538651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 480/977] 10.222.0.32 () {60 vars in 1131 bytes} [Tue Apr 12 00:13:22 2022] POST /identity/v3/users => generated 160 bytes in 167 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:22.545049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1bba8-e6d4-4056-b616-346f01d4eaab None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:22.653097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1bba8-e6d4-4056-b616-346f01d4eaab None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:22.694947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d99553-d818-4df4-8014-03adc20b59e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:22.695745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99553-d818-4df4-8014-03adc20b59e8 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:22.696027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99553-d818-4df4-8014-03adc20b59e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:22.696296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d99553-d818-4df4-8014-03adc20b59e8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:22.704613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d99553-d818-4df4-8014-03adc20b59e8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:22.706066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d99553-d818-4df4-8014-03adc20b59e8 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:22.720000 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-f2d99553-d818-4df4-8014-03adc20b59e8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 12 00:13:22.721503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 498/978] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:13:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:22.727559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:22.835153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75247632-b5e0-4a9a-8624-5f90a682d0d5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:22.869784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410e4c3-a8df-4a7d-9f47-532b3e22b2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:22.870491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410e4c3-a8df-4a7d-9f47-532b3e22b2e2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:22.870773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410e4c3-a8df-4a7d-9f47-532b3e22b2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:22.871042 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410e4c3-a8df-4a7d-9f47-532b3e22b2e2 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:22.871839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410e4c3-a8df-4a7d-9f47-532b3e22b2e2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:22.872136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410e4c3-a8df-4a7d-9f47-532b3e22b2e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:22.873773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410e4c3-a8df-4a7d-9f47-532b3e22b2e2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:22.914852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 481/979] 10.222.0.32 () {56 vars in 1101 bytes} [Tue Apr 12 00:13:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:23.616745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ed4b7-acd0-4b69-8a90-6c42b484975a None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:23.617264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ed4b7-acd0-4b69-8a90-6c42b484975a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:23.617377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ed4b7-acd0-4b69-8a90-6c42b484975a None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:23.618733 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 499/980] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:23.624011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f0c27-da61-4230-8230-1763ea163867 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:23.624409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f0c27-da61-4230-8230-1763ea163867 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:23.624579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f0c27-da61-4230-8230-1763ea163867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:23.643166 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-f70f0c27-da61-4230-8230-1763ea163867 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:23.644838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f70f0c27-da61-4230-8230-1763ea163867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:23.717163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 482/981] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:23.741311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ed4b7-acd0-4b69-8a90-6c42b484975a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:23.843888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ed4b7-acd0-4b69-8a90-6c42b484975a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:23.877034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0767a-49a7-46c9-8233-3aaaa924ff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:23.877773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0767a-49a7-46c9-8233-3aaaa924ff0f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:23.878058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0767a-49a7-46c9-8233-3aaaa924ff0f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:23.878435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0767a-49a7-46c9-8233-3aaaa924ff0f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:23.879085 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0767a-49a7-46c9-8233-3aaaa924ff0f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:23.880450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf0767a-49a7-46c9-8233-3aaaa924ff0f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:23.891952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-faf0767a-49a7-46c9-8233-3aaaa924ff0f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 00:13:23.897868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 500/982] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:23.899447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f0c27-da61-4230-8230-1763ea163867 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:23.992886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f0c27-da61-4230-8230-1763ea163867 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:24.015898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365afd7-f17d-4e90-ad72-5993bbf80e19 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:24.016177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365afd7-f17d-4e90-ad72-5993bbf80e19 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:24.016688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365afd7-f17d-4e90-ad72-5993bbf80e19 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:24.018111 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 501/983] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:24.022866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53a506-3406-4d8c-9ec9-ac1d1ec9e23f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:24.023218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53a506-3406-4d8c-9ec9-ac1d1ec9e23f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:24.023431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53a506-3406-4d8c-9ec9-ac1d1ec9e23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:24.025579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222645a6-53e6-4f81-98a7-19495e7cc7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:24.026246 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222645a6-53e6-4f81-98a7-19495e7cc7cb None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:24.026563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222645a6-53e6-4f81-98a7-19495e7cc7cb None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:24.026827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222645a6-53e6-4f81-98a7-19495e7cc7cb None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:24.027526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222645a6-53e6-4f81-98a7-19495e7cc7cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:24.027830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222645a6-53e6-4f81-98a7-19495e7cc7cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:24.029199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222645a6-53e6-4f81-98a7-19495e7cc7cb None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:24.040075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 483/984] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:24.041740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222645a6-53e6-4f81-98a7-19495e7cc7cb None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:24.046780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0d53a506-3406-4d8c-9ec9-ac1d1ec9e23f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:24.048016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0d53a506-3406-4d8c-9ec9-ac1d1ec9e23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:24.118624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 502/985] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:24.138134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222645a6-53e6-4f81-98a7-19495e7cc7cb None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:24.142587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53a506-3406-4d8c-9ec9-ac1d1ec9e23f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:24.174693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007711f9-5b7d-4457-ae0c-1e583628254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:24.175358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007711f9-5b7d-4457-ae0c-1e583628254d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:24.175661 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007711f9-5b7d-4457-ae0c-1e583628254d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:24.175908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007711f9-5b7d-4457-ae0c-1e583628254d None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:24.176628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007711f9-5b7d-4457-ae0c-1e583628254d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:24.176927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007711f9-5b7d-4457-ae0c-1e583628254d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:24.178308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007711f9-5b7d-4457-ae0c-1e583628254d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:24.183284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 484/986] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:24.189070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007711f9-5b7d-4457-ae0c-1e583628254d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:24.242007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53a506-3406-4d8c-9ec9-ac1d1ec9e23f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:24.274181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5c54-b86b-400d-b374-b6d7dca0e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:24.274868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5c54-b86b-400d-b374-b6d7dca0e666 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:24.275666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5c54-b86b-400d-b374-b6d7dca0e666 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:24.275944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5c54-b86b-400d-b374-b6d7dca0e666 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:24.276655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b5c54-b86b-400d-b374-b6d7dca0e666 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:24.277994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b5c54-b86b-400d-b374-b6d7dca0e666 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:24.285012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007711f9-5b7d-4457-ae0c-1e583628254d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:24.307776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 503/987] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:13:24 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:13:24.330698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacbcf0-4a71-4d6b-a243-f6c8735a5503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:24.331378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacbcf0-4a71-4d6b-a243-f6c8735a5503 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:24.331663 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacbcf0-4a71-4d6b-a243-f6c8735a5503 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:24.331945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacbcf0-4a71-4d6b-a243-f6c8735a5503 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:24.332803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacbcf0-4a71-4d6b-a243-f6c8735a5503 None admin] RBAC: Adding query filter params (interface=admin, service_id=d321889d6a09482990b037cdd2638146, region_id=RegionOne) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:24.333123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacbcf0-4a71-4d6b-a243-f6c8735a5503 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:24.334613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacbcf0-4a71-4d6b-a243-f6c8735a5503 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:24.341241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 485/988] 10.222.0.32 () {56 vars in 1249 bytes} [Tue Apr 12 00:13:24 2022] GET /identity/v3/endpoints?service_id=d321889d6a09482990b037cdd2638146&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:24.346883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5c54-b86b-400d-b374-b6d7dca0e666 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:24.451409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5c54-b86b-400d-b374-b6d7dca0e666 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:24.489661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6c7ca-c4e5-4eea-9ce2-d5062c55eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:24.490358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6c7ca-c4e5-4eea-9ce2-d5062c55eb42 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:24.490639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6c7ca-c4e5-4eea-9ce2-d5062c55eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:24.490913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6c7ca-c4e5-4eea-9ce2-d5062c55eb42 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:24.491584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6c7ca-c4e5-4eea-9ce2-d5062c55eb42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:24.492941 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6c7ca-c4e5-4eea-9ce2-d5062c55eb42 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:24.499741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 504/989] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 00:13:24 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:13:24.834196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e472d-0286-420b-9fe4-52bac8b15f0b None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:24.834732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e472d-0286-420b-9fe4-52bac8b15f0b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:24.834732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e472d-0286-420b-9fe4-52bac8b15f0b None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:24.836191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 486/990] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:24.841135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b481235-462a-4a0d-9233-58a01f247c0b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:24.841533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b481235-462a-4a0d-9233-58a01f247c0b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:24.841693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b481235-462a-4a0d-9233-58a01f247c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:24.858213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-8b481235-462a-4a0d-9233-58a01f247c0b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:24.859422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8b481235-462a-4a0d-9233-58a01f247c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:24.922199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 505/991] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:24.943502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e472d-0286-420b-9fe4-52bac8b15f0b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:25.037400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e472d-0286-420b-9fe4-52bac8b15f0b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:25.068996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bee00-430f-4cb0-85d9-3d9cddad6ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:25.069771 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bee00-430f-4cb0-85d9-3d9cddad6ebb None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:25.070050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bee00-430f-4cb0-85d9-3d9cddad6ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:25.070346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4bee00-430f-4cb0-85d9-3d9cddad6ebb None admin] PATH_INFO: `/v3/services/image` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:25.070985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bee00-430f-4cb0-85d9-3d9cddad6ebb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:25.072387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4bee00-430f-4cb0-85d9-3d9cddad6ebb None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:25.082718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-2b4bee00-430f-4cb0-85d9-3d9cddad6ebb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 00:13:25.084033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 487/992] 10.222.0.32 () {56 vars in 1105 bytes} [Tue Apr 12 00:13:24 2022] GET /identity/v3/services/image => generated 86 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:25.091614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b481235-462a-4a0d-9233-58a01f247c0b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:25.185224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b481235-462a-4a0d-9233-58a01f247c0b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:25.217303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56ffe5-d1d0-4842-b3cc-149c4387e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:25.217969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56ffe5-d1d0-4842-b3cc-149c4387e51c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:25.218276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56ffe5-d1d0-4842-b3cc-149c4387e51c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:25.218543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56ffe5-d1d0-4842-b3cc-149c4387e51c None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:25.219233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56ffe5-d1d0-4842-b3cc-149c4387e51c None admin] RBAC: Adding query filter params (name=image) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:25.219534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56ffe5-d1d0-4842-b3cc-149c4387e51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:25.220873 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56ffe5-d1d0-4842-b3cc-149c4387e51c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:25.225648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 506/993] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:25.231135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bee00-430f-4cb0-85d9-3d9cddad6ebb None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:25.328314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4bee00-430f-4cb0-85d9-3d9cddad6ebb None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:25.359867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a8dbc-2d2d-4f91-b4a6-a31ff0732c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:25.360453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a8dbc-2d2d-4f91-b4a6-a31ff0732c2f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:25.360731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a8dbc-2d2d-4f91-b4a6-a31ff0732c2f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:25.361003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a8dbc-2d2d-4f91-b4a6-a31ff0732c2f None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:25.361689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a8dbc-2d2d-4f91-b4a6-a31ff0732c2f None admin] RBAC: Adding query filter params (type=image) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:25.361989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a8dbc-2d2d-4f91-b4a6-a31ff0732c2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:25.363368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a8dbc-2d2d-4f91-b4a6-a31ff0732c2f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:25.367856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 488/994] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:26.669035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873c6d-b658-4a50-965a-423896c8caf1 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:26.669426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873c6d-b658-4a50-965a-423896c8caf1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:26.669600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873c6d-b658-4a50-965a-423896c8caf1 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:26.671150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 507/995] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:26.676351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40edc95-ef85-4556-b82b-bfe39c200ac1 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:26.676764 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40edc95-ef85-4556-b82b-bfe39c200ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:26.676959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40edc95-ef85-4556-b82b-bfe39c200ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:26.693825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e40edc95-ef85-4556-b82b-bfe39c200ac1 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:26.695046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e40edc95-ef85-4556-b82b-bfe39c200ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:26.760333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 489/996] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:26.784887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873c6d-b658-4a50-965a-423896c8caf1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:26.832150 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef8a2b-1eb4-4c10-8bae-8df0bfe3244b None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:26.832418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef8a2b-1eb4-4c10-8bae-8df0bfe3244b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:26.832710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef8a2b-1eb4-4c10-8bae-8df0bfe3244b None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:26.834354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 490/997] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:26.839953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc4771-ac72-4cf8-8ed0-cbbc44ae4505 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:26.840238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc4771-ac72-4cf8-8ed0-cbbc44ae4505 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:26.840536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc4771-ac72-4cf8-8ed0-cbbc44ae4505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:26.857552 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d8fc4771-ac72-4cf8-8ed0-cbbc44ae4505 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:26.858904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d8fc4771-ac72-4cf8-8ed0-cbbc44ae4505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:26.888734 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873c6d-b658-4a50-965a-423896c8caf1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:26.924607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd4c1c-9a8a-4308-a22d-57047b9cec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:26.925316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd4c1c-9a8a-4308-a22d-57047b9cec7e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:26.925604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd4c1c-9a8a-4308-a22d-57047b9cec7e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:26.925878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd4c1c-9a8a-4308-a22d-57047b9cec7e None admin] PATH_INFO: `/v3/services/compute` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:26.926933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd4c1c-9a8a-4308-a22d-57047b9cec7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:26.928293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd4c1c-9a8a-4308-a22d-57047b9cec7e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:26.931495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 491/998] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:26.942117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-acdd4c1c-9a8a-4308-a22d-57047b9cec7e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 00:13:26.946295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 508/999] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:26.949838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc4771-ac72-4cf8-8ed0-cbbc44ae4505 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:26.957125 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd4c1c-9a8a-4308-a22d-57047b9cec7e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:27.047937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc4771-ac72-4cf8-8ed0-cbbc44ae4505 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:27.057844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd4c1c-9a8a-4308-a22d-57047b9cec7e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:27.083312 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb7946-39cb-4471-a950-240e6c85a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:27.083992 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb7946-39cb-4471-a950-240e6c85a1ee None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.084274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb7946-39cb-4471-a950-240e6c85a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.084554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb7946-39cb-4471-a950-240e6c85a1ee None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.085308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb7946-39cb-4471-a950-240e6c85a1ee None admin] RBAC: Adding query filter params (name=compute) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:27.085555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb7946-39cb-4471-a950-240e6c85a1ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:27.086959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb7946-39cb-4471-a950-240e6c85a1ee None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:27.092503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db4ad-88c2-4724-8a96-d8e049cdcfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:27.097326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 492/1000] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:27.097450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db4ad-88c2-4724-8a96-d8e049cdcfea None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.097450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db4ad-88c2-4724-8a96-d8e049cdcfea None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.097450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5db4ad-88c2-4724-8a96-d8e049cdcfea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.097450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5db4ad-88c2-4724-8a96-d8e049cdcfea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:27.097450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5db4ad-88c2-4724-8a96-d8e049cdcfea None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:27.098814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb7946-39cb-4471-a950-240e6c85a1ee None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:27.107220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-7e5db4ad-88c2-4724-8a96-d8e049cdcfea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 12 00:13:27.108430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 509/1001] 10.222.0.32 () {56 vars in 1126 bytes} [Tue Apr 12 00:13:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:27.114388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db4ad-88c2-4724-8a96-d8e049cdcfea None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:27.195830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb7946-39cb-4471-a950-240e6c85a1ee None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:27.212385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5db4ad-88c2-4724-8a96-d8e049cdcfea None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:27.229278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a1b1-c0e8-4521-9d01-123782c45e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:27.229947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a1b1-c0e8-4521-9d01-123782c45e6a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.230236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a1b1-c0e8-4521-9d01-123782c45e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.230545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a1b1-c0e8-4521-9d01-123782c45e6a None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.231249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a1b1-c0e8-4521-9d01-123782c45e6a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:27.231564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a1b1-c0e8-4521-9d01-123782c45e6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:27.232926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a1b1-c0e8-4521-9d01-123782c45e6a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:27.237707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 493/1002] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:27.243373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a1b1-c0e8-4521-9d01-123782c45e6a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:27.245654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20853e1-9648-4f25-9b2d-554af5dd2204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:27.246360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20853e1-9648-4f25-9b2d-554af5dd2204 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.246648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20853e1-9648-4f25-9b2d-554af5dd2204 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.246927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20853e1-9648-4f25-9b2d-554af5dd2204 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.247634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20853e1-9648-4f25-9b2d-554af5dd2204 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:27.247939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20853e1-9648-4f25-9b2d-554af5dd2204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:27.249299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20853e1-9648-4f25-9b2d-554af5dd2204 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:27.255682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 510/1003] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:27.261661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20853e1-9648-4f25-9b2d-554af5dd2204 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:27.348013 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a1b1-c0e8-4521-9d01-123782c45e6a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:27.366137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20853e1-9648-4f25-9b2d-554af5dd2204 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:27.381693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec64a-7ed6-496e-8120-f57110f2e93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:27.382387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec64a-7ed6-496e-8120-f57110f2e93c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.382666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec64a-7ed6-496e-8120-f57110f2e93c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.382947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec64a-7ed6-496e-8120-f57110f2e93c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.383729 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec64a-7ed6-496e-8120-f57110f2e93c None admin] RBAC: Adding query filter params (interface=public, service_id=36884d2c16c44922b12cebb07788319f, region_id=RegionOne) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:27.384040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec64a-7ed6-496e-8120-f57110f2e93c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:27.386008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ec64a-7ed6-496e-8120-f57110f2e93c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:27.391254 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 494/1004] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 00:13:27 2022] GET /identity/v3/endpoints?service_id=36884d2c16c44922b12cebb07788319f&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:27.396387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec64a-7ed6-496e-8120-f57110f2e93c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:27.405715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bca1e-9426-45c0-ae28-93adc5154960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:27.406423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bca1e-9426-45c0-ae28-93adc5154960 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.406713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bca1e-9426-45c0-ae28-93adc5154960 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.406996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bca1e-9426-45c0-ae28-93adc5154960 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.407945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bca1e-9426-45c0-ae28-93adc5154960 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:27.408051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bca1e-9426-45c0-ae28-93adc5154960 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:27.409341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bca1e-9426-45c0-ae28-93adc5154960 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:27.414650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 511/1005] 10.222.0.32 () {56 vars in 1122 bytes} [Tue Apr 12 00:13:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:27.420155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bca1e-9426-45c0-ae28-93adc5154960 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:27.494732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ec64a-7ed6-496e-8120-f57110f2e93c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:27.520869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bca1e-9426-45c0-ae28-93adc5154960 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:27.527986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e66b3-46f7-4c0b-803a-ba77486ba791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:27.528704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e66b3-46f7-4c0b-803a-ba77486ba791 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.529044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e66b3-46f7-4c0b-803a-ba77486ba791 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.529328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e66b3-46f7-4c0b-803a-ba77486ba791 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.530008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e66b3-46f7-4c0b-803a-ba77486ba791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:27.531404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e66b3-46f7-4c0b-803a-ba77486ba791 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:27.550281 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 495/1006] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 00:13:27 2022] GET /identity/v3/services => generated 1727 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:13:27.553993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e948811d-8d73-4c1f-b540-c2496c2bb6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:27.554709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948811d-8d73-4c1f-b540-c2496c2bb6f6 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.554988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948811d-8d73-4c1f-b540-c2496c2bb6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.555262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948811d-8d73-4c1f-b540-c2496c2bb6f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.556136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948811d-8d73-4c1f-b540-c2496c2bb6f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:27.558074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e948811d-8d73-4c1f-b540-c2496c2bb6f6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:27.582286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 512/1007] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 00:13:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:13:27.682809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a1b1-d997-41e8-b1ef-0e6ce9839614 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.683384 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a1b1-d997-41e8-b1ef-0e6ce9839614 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.683384 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527a1b1-d997-41e8-b1ef-0e6ce9839614 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.685036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 496/1008] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:27.690857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3319ce3-a235-43e3-8e99-1842d6bb1640 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.691384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3319ce3-a235-43e3-8e99-1842d6bb1640 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.691494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3319ce3-a235-43e3-8e99-1842d6bb1640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.709741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d3319ce3-a235-43e3-8e99-1842d6bb1640 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:27.711014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d3319ce3-a235-43e3-8e99-1842d6bb1640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:27.788316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 513/1009] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:27.812094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527a1b1-d997-41e8-b1ef-0e6ce9839614 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:27.909610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527a1b1-d997-41e8-b1ef-0e6ce9839614 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:27.942195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7634-966e-4c59-aaed-3d84ba050c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:27.942886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7634-966e-4c59-aaed-3d84ba050c2b None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:27.943169 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7634-966e-4c59-aaed-3d84ba050c2b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:27.943438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7634-966e-4c59-aaed-3d84ba050c2b None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:27.944148 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7634-966e-4c59-aaed-3d84ba050c2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:27.945501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7634-966e-4c59-aaed-3d84ba050c2b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:27.959131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 497/1010] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:13:27 2022] POST /identity/v3/services => generated 242 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:29.840391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0789-1dde-4199-bdae-8d71aacf58a6 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:29.840946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0789-1dde-4199-bdae-8d71aacf58a6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:29.840946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e0789-1dde-4199-bdae-8d71aacf58a6 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:29.842466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 514/1011] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:29.847419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670af54-7fdb-4f67-a75e-2c41c7616309 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:29.847806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670af54-7fdb-4f67-a75e-2c41c7616309 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:29.848002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670af54-7fdb-4f67-a75e-2c41c7616309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:29.864780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0670af54-7fdb-4f67-a75e-2c41c7616309 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:29.865954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0670af54-7fdb-4f67-a75e-2c41c7616309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:29.917740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec45889-f0e4-46f4-8c5e-74eb86abddea None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:29.918142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec45889-f0e4-46f4-8c5e-74eb86abddea None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:29.918352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec45889-f0e4-46f4-8c5e-74eb86abddea None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:29.919882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 515/1012] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:29.925558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267acb0-5ab5-4a99-853e-84b530e9205d None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:29.925852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267acb0-5ab5-4a99-853e-84b530e9205d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:29.926137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267acb0-5ab5-4a99-853e-84b530e9205d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:29.939689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 498/1013] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:29 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:29.942749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0267acb0-5ab5-4a99-853e-84b530e9205d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:29.943935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0267acb0-5ab5-4a99-853e-84b530e9205d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:29.963480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670af54-7fdb-4f67-a75e-2c41c7616309 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:30.010900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 516/1014] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:29 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:30.034383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267acb0-5ab5-4a99-853e-84b530e9205d None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:30.059130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670af54-7fdb-4f67-a75e-2c41c7616309 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:30.091634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560da316-5ef5-48c5-8583-948cfcd78c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:30.092417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560da316-5ef5-48c5-8583-948cfcd78c1b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.092696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560da316-5ef5-48c5-8583-948cfcd78c1b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.092968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560da316-5ef5-48c5-8583-948cfcd78c1b None admin] PATH_INFO: `/v3/services/compute` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.093707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560da316-5ef5-48c5-8583-948cfcd78c1b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:30.095143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560da316-5ef5-48c5-8583-948cfcd78c1b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:30.107070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-560da316-5ef5-48c5-8583-948cfcd78c1b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 12 00:13:30.108424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 499/1015] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:30.113957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560da316-5ef5-48c5-8583-948cfcd78c1b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:30.130897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267acb0-5ab5-4a99-853e-84b530e9205d None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:30.166433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed785-d77c-47b5-b2da-530f43d97cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:30.167231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed785-d77c-47b5-b2da-530f43d97cd2 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.167517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed785-d77c-47b5-b2da-530f43d97cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.167794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ed785-d77c-47b5-b2da-530f43d97cd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.169032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed785-d77c-47b5-b2da-530f43d97cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:30.170432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ed785-d77c-47b5-b2da-530f43d97cd2 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:30.172234 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 517/1016] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:30.177591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed785-d77c-47b5-b2da-530f43d97cd2 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:30.208662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560da316-5ef5-48c5-8583-948cfcd78c1b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:30.241179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f89217-72e5-4226-9dbc-79e19b1d9c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:30.241842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f89217-72e5-4226-9dbc-79e19b1d9c90 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.242131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f89217-72e5-4226-9dbc-79e19b1d9c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.242440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f89217-72e5-4226-9dbc-79e19b1d9c90 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.243146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f89217-72e5-4226-9dbc-79e19b1d9c90 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:30.243450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f89217-72e5-4226-9dbc-79e19b1d9c90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:30.244909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f89217-72e5-4226-9dbc-79e19b1d9c90 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:30.254512 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 500/1017] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:30.255469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f89217-72e5-4226-9dbc-79e19b1d9c90 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:30.271463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ed785-d77c-47b5-b2da-530f43d97cd2 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:30.304682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3db21-f848-46d8-ae49-3f8718f7efa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:30.305340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3db21-f848-46d8-ae49-3f8718f7efa0 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.305623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3db21-f848-46d8-ae49-3f8718f7efa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.305900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3db21-f848-46d8-ae49-3f8718f7efa0 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.307178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3db21-f848-46d8-ae49-3f8718f7efa0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:30.308587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3db21-f848-46d8-ae49-3f8718f7efa0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:30.335551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 518/1018] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:13:30 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:13:30.339760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1af993-8acb-47d5-b528-90d344442b4f None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.340049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1af993-8acb-47d5-b528-90d344442b4f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.340355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1af993-8acb-47d5-b528-90d344442b4f None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.341719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 519/1019] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:30.347684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db33dbf-d1a8-4f23-b05a-de7f120c490a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.348051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db33dbf-d1a8-4f23-b05a-de7f120c490a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.348242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db33dbf-d1a8-4f23-b05a-de7f120c490a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.355169 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f89217-72e5-4226-9dbc-79e19b1d9c90 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:30.365838 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-9db33dbf-d1a8-4f23-b05a-de7f120c490a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:30.367162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9db33dbf-d1a8-4f23-b05a-de7f120c490a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:30.391785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1396c4-80c8-4a32-bde7-0022b6ec5010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:30.392474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1396c4-80c8-4a32-bde7-0022b6ec5010 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.392761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1396c4-80c8-4a32-bde7-0022b6ec5010 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.393038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1396c4-80c8-4a32-bde7-0022b6ec5010 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.393779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1396c4-80c8-4a32-bde7-0022b6ec5010 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:30.394055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1396c4-80c8-4a32-bde7-0022b6ec5010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:30.395496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1396c4-80c8-4a32-bde7-0022b6ec5010 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:30.406444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 501/1020] 10.222.0.32 () {56 vars in 1112 bytes} [Tue Apr 12 00:13:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:30.407533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1396c4-80c8-4a32-bde7-0022b6ec5010 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:30.443872 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 520/1021] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:30 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:30.468639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db33dbf-d1a8-4f23-b05a-de7f120c490a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:30.512206 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1396c4-80c8-4a32-bde7-0022b6ec5010 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:30.548728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2743e-e5d2-47c1-b13c-25f0929bfc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:30.549392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2743e-e5d2-47c1-b13c-25f0929bfc68 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.549674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2743e-e5d2-47c1-b13c-25f0929bfc68 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.549948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2743e-e5d2-47c1-b13c-25f0929bfc68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.550713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2743e-e5d2-47c1-b13c-25f0929bfc68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:30.552073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2743e-e5d2-47c1-b13c-25f0929bfc68 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:30.568376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db33dbf-d1a8-4f23-b05a-de7f120c490a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:30.571116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 502/1022] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 00:13:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:30.611527 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a263d-1dde-4d84-8007-38f7757f05c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:30.612328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a263d-1dde-4d84-8007-38f7757f05c1 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.612608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a263d-1dde-4d84-8007-38f7757f05c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.612882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a263d-1dde-4d84-8007-38f7757f05c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.613525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a263d-1dde-4d84-8007-38f7757f05c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:30.614931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a263d-1dde-4d84-8007-38f7757f05c1 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:30.626311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-ba7a263d-1dde-4d84-8007-38f7757f05c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 00:13:30.627578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 521/1023] 10.222.0.32 () {56 vars in 1105 bytes} [Tue Apr 12 00:13:30 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:30.633702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2743e-e5d2-47c1-b13c-25f0929bfc68 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:30.738277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2743e-e5d2-47c1-b13c-25f0929bfc68 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:30.772723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e01fa8-7481-44a3-a795-db2c8af44a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:30.773788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01fa8-7481-44a3-a795-db2c8af44a1f None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.774074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01fa8-7481-44a3-a795-db2c8af44a1f None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.774401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01fa8-7481-44a3-a795-db2c8af44a1f None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.775191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01fa8-7481-44a3-a795-db2c8af44a1f None admin] RBAC: Adding query filter params (name=image) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:30.775500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01fa8-7481-44a3-a795-db2c8af44a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:30.776873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01fa8-7481-44a3-a795-db2c8af44a1f None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:30.782322 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 503/1024] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:30.787648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a263d-1dde-4d84-8007-38f7757f05c1 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:30.887271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a263d-1dde-4d84-8007-38f7757f05c1 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:30.919462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40462507-3e31-42cc-8cd1-68968b753d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:30.920119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40462507-3e31-42cc-8cd1-68968b753d01 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:30.920398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40462507-3e31-42cc-8cd1-68968b753d01 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:30.920669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40462507-3e31-42cc-8cd1-68968b753d01 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:30.921357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40462507-3e31-42cc-8cd1-68968b753d01 None admin] RBAC: Adding query filter params (type=image) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:30.921657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40462507-3e31-42cc-8cd1-68968b753d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:30.923019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40462507-3e31-42cc-8cd1-68968b753d01 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:30.927813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 522/1025] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:30.933352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e01fa8-7481-44a3-a795-db2c8af44a1f None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:31.026224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e01fa8-7481-44a3-a795-db2c8af44a1f None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:31.057878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ba527-95b4-446e-81b6-98d8936af508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:31.058564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba527-95b4-446e-81b6-98d8936af508 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:31.058844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba527-95b4-446e-81b6-98d8936af508 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:31.059116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba527-95b4-446e-81b6-98d8936af508 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:31.059885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ba527-95b4-446e-81b6-98d8936af508 None admin] RBAC: Adding query filter params (interface=public, service_id=ff641ff3fd334fe899c40b219d2c6369, region_id=RegionOne) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:31.060189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ba527-95b4-446e-81b6-98d8936af508 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:31.061549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ba527-95b4-446e-81b6-98d8936af508 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:31.070937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 504/1026] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 00:13:30 2022] GET /identity/v3/endpoints?service_id=ff641ff3fd334fe899c40b219d2c6369&interface=public®ion_id=RegionOne => generated 194 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:31.073140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40462507-3e31-42cc-8cd1-68968b753d01 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:31.166348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40462507-3e31-42cc-8cd1-68968b753d01 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:31.198569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabacba-04b7-4c88-9b54-52b72b525ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:31.199240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabacba-04b7-4c88-9b54-52b72b525ee9 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:31.199522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabacba-04b7-4c88-9b54-52b72b525ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:31.199796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabacba-04b7-4c88-9b54-52b72b525ee9 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:31.200466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabacba-04b7-4c88-9b54-52b72b525ee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:31.201822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabacba-04b7-4c88-9b54-52b72b525ee9 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:31.208279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 523/1027] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 00:13:31 2022] GET /identity/v3/services => generated 1957 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:32.697740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caca0e-9d0c-4432-85e6-dfa7453da59a None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:32.698216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caca0e-9d0c-4432-85e6-dfa7453da59a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:32.698501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caca0e-9d0c-4432-85e6-dfa7453da59a None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:32.699823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 505/1028] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:32.704893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c702358-2378-4b78-bf2a-fc884af47496 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:32.705272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c702358-2378-4b78-bf2a-fc884af47496 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:32.705448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c702358-2378-4b78-bf2a-fc884af47496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:32.722696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2c702358-2378-4b78-bf2a-fc884af47496 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:32.723884 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2c702358-2378-4b78-bf2a-fc884af47496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:32.790292 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 524/1029] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:32.813825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caca0e-9d0c-4432-85e6-dfa7453da59a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:32.911063 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caca0e-9d0c-4432-85e6-dfa7453da59a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:32.943284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d6126-3e04-4af2-b5eb-0facefb2a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:32.944077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d6126-3e04-4af2-b5eb-0facefb2a634 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:32.944355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d6126-3e04-4af2-b5eb-0facefb2a634 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:32.944622 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d6126-3e04-4af2-b5eb-0facefb2a634 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:32.945768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d6126-3e04-4af2-b5eb-0facefb2a634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:32.947760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d6126-3e04-4af2-b5eb-0facefb2a634 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:32.953920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 506/1030] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:32.955436 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c702358-2378-4b78-bf2a-fc884af47496 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:32.990516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbca63-464d-4d9c-92b6-005f5c53c48b None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:32.990857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbca63-464d-4d9c-92b6-005f5c53c48b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:32.991080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbca63-464d-4d9c-92b6-005f5c53c48b None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:32.992445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 507/1031] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:32.997529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a845c-3bd4-4215-b028-dc2c476512e2 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:32.997818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a845c-3bd4-4215-b028-dc2c476512e2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:32.998098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a845c-3bd4-4215-b028-dc2c476512e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.014636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a34a845c-3bd4-4215-b028-dc2c476512e2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:33.015826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a34a845c-3bd4-4215-b028-dc2c476512e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:33.055842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c702358-2378-4b78-bf2a-fc884af47496 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:33.079813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 508/1032] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:33.089420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cfb47-d411-4ee7-a79f-a784c3df3997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:33.090090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cfb47-d411-4ee7-a79f-a784c3df3997 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.090402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cfb47-d411-4ee7-a79f-a784c3df3997 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.090678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cfb47-d411-4ee7-a79f-a784c3df3997 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.091382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cfb47-d411-4ee7-a79f-a784c3df3997 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:33.092795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cfb47-d411-4ee7-a79f-a784c3df3997 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:33.104602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a845c-3bd4-4215-b028-dc2c476512e2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:33.115707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 525/1033] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:13:32 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:33.210361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a845c-3bd4-4215-b028-dc2c476512e2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:33.245531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afba80-7fab-4e26-9897-fc6440957cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:33.246397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afba80-7fab-4e26-9897-fc6440957cba None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.246678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afba80-7fab-4e26-9897-fc6440957cba None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.246943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afba80-7fab-4e26-9897-fc6440957cba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.258319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afba80-7fab-4e26-9897-fc6440957cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:33.265883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-f6afba80-7fab-4e26-9897-fc6440957cba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 00:13:33.267357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 509/1034] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 00:13:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:33.273185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cfb47-d411-4ee7-a79f-a784c3df3997 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:33.379956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cfb47-d411-4ee7-a79f-a784c3df3997 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:33.413706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0342d-415f-466b-a464-087629e29d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:33.414407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0342d-415f-466b-a464-087629e29d21 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.414688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0342d-415f-466b-a464-087629e29d21 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.414966 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0342d-415f-466b-a464-087629e29d21 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.415751 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0342d-415f-466b-a464-087629e29d21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:33.416052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0342d-415f-466b-a464-087629e29d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:33.417398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0342d-415f-466b-a464-087629e29d21 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:33.425279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 526/1035] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 00:13:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:33.430690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afba80-7fab-4e26-9897-fc6440957cba None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:33.497356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20e7e6-85ca-4da0-a220-df301c1c6cd3 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.497659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20e7e6-85ca-4da0-a220-df301c1c6cd3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.497829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20e7e6-85ca-4da0-a220-df301c1c6cd3 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.499343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 527/1036] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:33.503982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc82bd9-37a6-4971-b210-405e50c8490f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.504289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc82bd9-37a6-4971-b210-405e50c8490f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.504547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc82bd9-37a6-4971-b210-405e50c8490f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.521437 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-7fc82bd9-37a6-4971-b210-405e50c8490f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:33.522622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7fc82bd9-37a6-4971-b210-405e50c8490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:33.527542 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afba80-7fab-4e26-9897-fc6440957cba None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:33.560405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3afc3a-0ca5-478d-8f29-a662c13f2577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:33.561199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3afc3a-0ca5-478d-8f29-a662c13f2577 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.561471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3afc3a-0ca5-478d-8f29-a662c13f2577 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.561746 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3afc3a-0ca5-478d-8f29-a662c13f2577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.572556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3afc3a-0ca5-478d-8f29-a662c13f2577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:33.573993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3afc3a-0ca5-478d-8f29-a662c13f2577 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:33.587854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 528/1037] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:33.589715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-8c3afc3a-0ca5-478d-8f29-a662c13f2577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:33.591036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 510/1038] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:33.596413 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc82bd9-37a6-4971-b210-405e50c8490f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:33.611415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3afc3a-0ca5-478d-8f29-a662c13f2577 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:33.695250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc82bd9-37a6-4971-b210-405e50c8490f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:33.707298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3afc3a-0ca5-478d-8f29-a662c13f2577 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:33.731198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1e09-8a3a-4b77-ac81-7c89dc687b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:33.732491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1e09-8a3a-4b77-ac81-7c89dc687b33 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.732982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1e09-8a3a-4b77-ac81-7c89dc687b33 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.733438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1e09-8a3a-4b77-ac81-7c89dc687b33 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.734360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d1e09-8a3a-4b77-ac81-7c89dc687b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:33.734665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d1e09-8a3a-4b77-ac81-7c89dc687b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:33.736001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d1e09-8a3a-4b77-ac81-7c89dc687b33 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:33.740175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421faae8-7a2c-4622-8472-9a23c54bb6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:33.740961 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421faae8-7a2c-4622-8472-9a23c54bb6f2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.741290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421faae8-7a2c-4622-8472-9a23c54bb6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.741558 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421faae8-7a2c-4622-8472-9a23c54bb6f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.742235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421faae8-7a2c-4622-8472-9a23c54bb6f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:33.744440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421faae8-7a2c-4622-8472-9a23c54bb6f2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:33.751841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 529/1039] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:33.752593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1e09-8a3a-4b77-ac81-7c89dc687b33 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:33.754651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-421faae8-7a2c-4622-8472-9a23c54bb6f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 12 00:13:33.756391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 511/1040] 10.222.0.32 () {56 vars in 1105 bytes} [Tue Apr 12 00:13:33 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:33.761324 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421faae8-7a2c-4622-8472-9a23c54bb6f2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:33.851801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d1e09-8a3a-4b77-ac81-7c89dc687b33 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:33.856504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421faae8-7a2c-4622-8472-9a23c54bb6f2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:33.885689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592168a-d6df-4035-bb3f-5725bd760b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:33.886641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592168a-d6df-4035-bb3f-5725bd760b28 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.886921 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592168a-d6df-4035-bb3f-5725bd760b28 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.887189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592168a-d6df-4035-bb3f-5725bd760b28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.889343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30be57-94ed-44c4-bbb1-e187fbcad5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:33.890006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30be57-94ed-44c4-bbb1-e187fbcad5ce None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:33.890318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30be57-94ed-44c4-bbb1-e187fbcad5ce None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:33.890627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30be57-94ed-44c4-bbb1-e187fbcad5ce None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:33.891333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30be57-94ed-44c4-bbb1-e187fbcad5ce None admin] RBAC: Adding query filter params (name=image) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:33.891641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30be57-94ed-44c4-bbb1-e187fbcad5ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:33.892998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30be57-94ed-44c4-bbb1-e187fbcad5ce None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:33.895466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592168a-d6df-4035-bb3f-5725bd760b28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:33.896884 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592168a-d6df-4035-bb3f-5725bd760b28 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:33.897978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 512/1041] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:33.903965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30be57-94ed-44c4-bbb1-e187fbcad5ce None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:33.910448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-b592168a-d6df-4035-bb3f-5725bd760b28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 00:13:33.911908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 530/1042] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 00:13:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:33.917468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592168a-d6df-4035-bb3f-5725bd760b28 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:34.003848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30be57-94ed-44c4-bbb1-e187fbcad5ce None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:34.019814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592168a-d6df-4035-bb3f-5725bd760b28 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:34.035932 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547d889-c6a9-445e-a16e-25f0e45708c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:34.036600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547d889-c6a9-445e-a16e-25f0e45708c3 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:34.036883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547d889-c6a9-445e-a16e-25f0e45708c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:34.037158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547d889-c6a9-445e-a16e-25f0e45708c3 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:34.038112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547d889-c6a9-445e-a16e-25f0e45708c3 None admin] RBAC: Adding query filter params (type=image) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:34.038443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547d889-c6a9-445e-a16e-25f0e45708c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:34.039800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547d889-c6a9-445e-a16e-25f0e45708c3 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:34.044989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 513/1043] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:34.050967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547d889-c6a9-445e-a16e-25f0e45708c3 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:34.064326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953956f-1d05-4f2d-b65d-40d879c4183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:34.065020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953956f-1d05-4f2d-b65d-40d879c4183e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:34.065478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953956f-1d05-4f2d-b65d-40d879c4183e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:34.065765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953956f-1d05-4f2d-b65d-40d879c4183e None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:34.067156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953956f-1d05-4f2d-b65d-40d879c4183e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:34.067594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953956f-1d05-4f2d-b65d-40d879c4183e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:34.069472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953956f-1d05-4f2d-b65d-40d879c4183e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:34.086706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 531/1044] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 00:13:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:34.092847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953956f-1d05-4f2d-b65d-40d879c4183e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:34.164419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547d889-c6a9-445e-a16e-25f0e45708c3 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:34.188759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953956f-1d05-4f2d-b65d-40d879c4183e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:34.196701 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c884e-17b8-4048-81c8-aa8e9194b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:34.197360 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c884e-17b8-4048-81c8-aa8e9194b043 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:34.197644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c884e-17b8-4048-81c8-aa8e9194b043 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:34.197922 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c884e-17b8-4048-81c8-aa8e9194b043 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:34.198682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c884e-17b8-4048-81c8-aa8e9194b043 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:34.200053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c884e-17b8-4048-81c8-aa8e9194b043 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:34.218869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 514/1045] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 00:13:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:34.234959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64389af2-dc94-4f7e-b0a5-21f0bd77b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:34.235630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64389af2-dc94-4f7e-b0a5-21f0bd77b679 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:34.235913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64389af2-dc94-4f7e-b0a5-21f0bd77b679 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:34.236184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64389af2-dc94-4f7e-b0a5-21f0bd77b679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:34.307442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64389af2-dc94-4f7e-b0a5-21f0bd77b679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:34.308820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64389af2-dc94-4f7e-b0a5-21f0bd77b679 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:34.410139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 532/1046] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 00:13:34.415131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c884e-17b8-4048-81c8-aa8e9194b043 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:34.515051 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c884e-17b8-4048-81c8-aa8e9194b043 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:34.547563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55e055-55eb-4228-bbea-7337b7eac97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:34.548348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55e055-55eb-4228-bbea-7337b7eac97d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:34.548629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55e055-55eb-4228-bbea-7337b7eac97d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:34.548900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55e055-55eb-4228-bbea-7337b7eac97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:34.559651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55e055-55eb-4228-bbea-7337b7eac97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:34.561020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55e055-55eb-4228-bbea-7337b7eac97d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:34.576942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-1b55e055-55eb-4228-bbea-7337b7eac97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:34.582619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 515/1047] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:34.583809 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64389af2-dc94-4f7e-b0a5-21f0bd77b679 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:34.678903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64389af2-dc94-4f7e-b0a5-21f0bd77b679 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:34.711347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd0b5f-5733-4d8b-90a0-129b5c4c384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:34.712007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd0b5f-5733-4d8b-90a0-129b5c4c384f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:34.712329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd0b5f-5733-4d8b-90a0-129b5c4c384f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:34.712605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd0b5f-5733-4d8b-90a0-129b5c4c384f None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:34.713314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd0b5f-5733-4d8b-90a0-129b5c4c384f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:34.713620 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd0b5f-5733-4d8b-90a0-129b5c4c384f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:34.714989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd0b5f-5733-4d8b-90a0-129b5c4c384f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:34.730619 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 533/1048] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:34.731956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55e055-55eb-4228-bbea-7337b7eac97d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:34.827429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55e055-55eb-4228-bbea-7337b7eac97d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:34.859937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fbc53-eb3a-45f9-b1c6-8aa05f825503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:34.860949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fbc53-eb3a-45f9-b1c6-8aa05f825503 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:34.861386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fbc53-eb3a-45f9-b1c6-8aa05f825503 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:34.861835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fbc53-eb3a-45f9-b1c6-8aa05f825503 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:34.868352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fbc53-eb3a-45f9-b1c6-8aa05f825503 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:34.869972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294fbc53-eb3a-45f9-b1c6-8aa05f825503 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:34.883335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-294fbc53-eb3a-45f9-b1c6-8aa05f825503 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:34.885074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 516/1049] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:34.890650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd0b5f-5733-4d8b-90a0-129b5c4c384f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:34.988998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd0b5f-5733-4d8b-90a0-129b5c4c384f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:35.020818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52839a61-556d-4107-992c-303781ab9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:35.021483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839a61-556d-4107-992c-303781ab9162 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:35.021802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839a61-556d-4107-992c-303781ab9162 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:35.022088 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52839a61-556d-4107-992c-303781ab9162 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:35.022967 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839a61-556d-4107-992c-303781ab9162 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:35.023276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839a61-556d-4107-992c-303781ab9162 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:35.025230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52839a61-556d-4107-992c-303781ab9162 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:35.042289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 534/1050] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:35.044105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fbc53-eb3a-45f9-b1c6-8aa05f825503 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:35.142839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fbc53-eb3a-45f9-b1c6-8aa05f825503 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:35.177499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f377440-7072-4af7-865c-828c8a5daab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:35.178157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f377440-7072-4af7-865c-828c8a5daab4 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:35.178477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f377440-7072-4af7-865c-828c8a5daab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:35.178754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f377440-7072-4af7-865c-828c8a5daab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:35.179577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f377440-7072-4af7-865c-828c8a5daab4 None admin] RBAC: Adding query filter params (role.id=ed1b3a4e24f2471288b84816ceb586c6, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=ecf0479293de4edfbf2815c1e9f2f7cc) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:35.179886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f377440-7072-4af7-865c-828c8a5daab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:35.181351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f377440-7072-4af7-865c-828c8a5daab4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:35.194630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 517/1051] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:35 2022] GET /identity/v3/role_assignments?user.id=ecf0479293de4edfbf2815c1e9f2f7cc&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=ed1b3a4e24f2471288b84816ceb586c6 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:35.511052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baacab-d7cb-4d46-9f3f-d1a2e4e36280 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:35.511423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baacab-d7cb-4d46-9f3f-d1a2e4e36280 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:35.511623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baacab-d7cb-4d46-9f3f-d1a2e4e36280 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:35.513113 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 535/1052] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:35.518200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50b5b3-84df-4801-a82b-0536c6f8685c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:35.518519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50b5b3-84df-4801-a82b-0536c6f8685c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:35.518797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50b5b3-84df-4801-a82b-0536c6f8685c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:35.535621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-be50b5b3-84df-4801-a82b-0536c6f8685c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:35.536789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-be50b5b3-84df-4801-a82b-0536c6f8685c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:35.599963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 518/1053] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:35.624597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baacab-d7cb-4d46-9f3f-d1a2e4e36280 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:35.729761 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baacab-d7cb-4d46-9f3f-d1a2e4e36280 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:35.761759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211dd09-d976-437c-9990-ff8b9f488c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:35.762510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211dd09-d976-437c-9990-ff8b9f488c77 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:35.762790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211dd09-d976-437c-9990-ff8b9f488c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:35.763064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211dd09-d976-437c-9990-ff8b9f488c77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:35.772664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211dd09-d976-437c-9990-ff8b9f488c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:35.780025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-f211dd09-d976-437c-9990-ff8b9f488c77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:13:35.781366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 536/1054] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:35.787225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50b5b3-84df-4801-a82b-0536c6f8685c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:35.881007 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50b5b3-84df-4801-a82b-0536c6f8685c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:35.912403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62565c-7111-4bd1-9d3b-c795bc2ef619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:35.913320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62565c-7111-4bd1-9d3b-c795bc2ef619 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:35.913598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62565c-7111-4bd1-9d3b-c795bc2ef619 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:35.913866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62565c-7111-4bd1-9d3b-c795bc2ef619 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:35.914632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62565c-7111-4bd1-9d3b-c795bc2ef619 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:35.914934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62565c-7111-4bd1-9d3b-c795bc2ef619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:35.916813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62565c-7111-4bd1-9d3b-c795bc2ef619 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:35.924901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 519/1055] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:35.930664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211dd09-d976-437c-9990-ff8b9f488c77 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:36.024573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211dd09-d976-437c-9990-ff8b9f488c77 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:36.056507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698d250-0600-47ee-8d24-f2f30cd145f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:36.057377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698d250-0600-47ee-8d24-f2f30cd145f0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:36.057663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698d250-0600-47ee-8d24-f2f30cd145f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:36.057937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698d250-0600-47ee-8d24-f2f30cd145f0 None admin] PATH_INFO: `/v3/users/eafe08f04a6f4b2ea084a2d2cd2b1ec1` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:36.070614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698d250-0600-47ee-8d24-f2f30cd145f0 None admin] RBAC: Authorizing `identity:get_user(user_id=eafe08f04a6f4b2ea084a2d2cd2b1ec1)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:36.072569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698d250-0600-47ee-8d24-f2f30cd145f0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:36.074407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 537/1056] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:13:35 2022] GET /identity/v3/users/eafe08f04a6f4b2ea084a2d2cd2b1ec1 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:36.080066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62565c-7111-4bd1-9d3b-c795bc2ef619 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:36.178177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62565c-7111-4bd1-9d3b-c795bc2ef619 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:36.218195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea62ff4-e5a9-4e7b-a6ef-e8c77cf2b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:36.218876 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea62ff4-e5a9-4e7b-a6ef-e8c77cf2b245 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:36.219162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea62ff4-e5a9-4e7b-a6ef-e8c77cf2b245 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:36.219440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea62ff4-e5a9-4e7b-a6ef-e8c77cf2b245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:36.283279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea62ff4-e5a9-4e7b-a6ef-e8c77cf2b245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:36.284667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea62ff4-e5a9-4e7b-a6ef-e8c77cf2b245 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:36.378680 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 520/1057] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:13:36.384995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698d250-0600-47ee-8d24-f2f30cd145f0 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:36.477025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698d250-0600-47ee-8d24-f2f30cd145f0 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:36.508496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79497a48-9c40-476e-be1e-53ebc4f71d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:36.509399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497a48-9c40-476e-be1e-53ebc4f71d59 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:36.509678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497a48-9c40-476e-be1e-53ebc4f71d59 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:36.509947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79497a48-9c40-476e-be1e-53ebc4f71d59 None admin] PATH_INFO: `/v3/projects/b131d2f866a04983b57a0b1a712d2da0` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:36.511132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79497a48-9c40-476e-be1e-53ebc4f71d59 None admin] RBAC: Authorizing `identity:get_project(project_id=b131d2f866a04983b57a0b1a712d2da0)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:36.512544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79497a48-9c40-476e-be1e-53ebc4f71d59 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:36.514379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 538/1058] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:13:36 2022] GET /identity/v3/projects/b131d2f866a04983b57a0b1a712d2da0 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:36.520374 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea62ff4-e5a9-4e7b-a6ef-e8c77cf2b245 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:36.565758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f039c3-c3af-4ced-bfc0-702aa4452ae8 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:36.566044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f039c3-c3af-4ced-bfc0-702aa4452ae8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:36.566273 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f039c3-c3af-4ced-bfc0-702aa4452ae8 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:36.567981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 539/1059] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:36.572948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e796ef-f344-41b9-aa96-e71d3f618ed4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:36.573232 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e796ef-f344-41b9-aa96-e71d3f618ed4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:36.573505 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e796ef-f344-41b9-aa96-e71d3f618ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:36.589727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-54e796ef-f344-41b9-aa96-e71d3f618ed4 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:36.590927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-54e796ef-f344-41b9-aa96-e71d3f618ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:36.615767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea62ff4-e5a9-4e7b-a6ef-e8c77cf2b245 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:36.648887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac4696-5327-4813-9d89-5dd35061523e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:36.649544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac4696-5327-4813-9d89-5dd35061523e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:36.649904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac4696-5327-4813-9d89-5dd35061523e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:36.650183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac4696-5327-4813-9d89-5dd35061523e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:36.651032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac4696-5327-4813-9d89-5dd35061523e None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=b131d2f866a04983b57a0b1a712d2da0, user.id=eafe08f04a6f4b2ea084a2d2cd2b1ec1) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:36.651347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac4696-5327-4813-9d89-5dd35061523e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:36.652767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac4696-5327-4813-9d89-5dd35061523e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:36.655245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 540/1060] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:36.658288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 521/1061] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:36 2022] GET /identity/v3/role_assignments?user.id=eafe08f04a6f4b2ea084a2d2cd2b1ec1&scope.project.id=b131d2f866a04983b57a0b1a712d2da0&role.id=f0208c43117c4b799194c83781a46e09 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:36.682811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e796ef-f344-41b9-aa96-e71d3f618ed4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:36.784364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e796ef-f344-41b9-aa96-e71d3f618ed4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:36.820115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2e895-8df4-4ec7-842a-b9efee68f77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:36.820696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2e895-8df4-4ec7-842a-b9efee68f77f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:36.820975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2e895-8df4-4ec7-842a-b9efee68f77f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:36.821242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2e895-8df4-4ec7-842a-b9efee68f77f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:36.887774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2e895-8df4-4ec7-842a-b9efee68f77f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:36.889207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2e895-8df4-4ec7-842a-b9efee68f77f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:36.982494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 541/1062] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:13:36.988837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac4696-5327-4813-9d89-5dd35061523e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:37.084757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac4696-5327-4813-9d89-5dd35061523e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:37.117844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2d1fb-e9b0-45dc-ab60-7b8db7f76243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:37.119570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2d1fb-e9b0-45dc-ab60-7b8db7f76243 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:37.120044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2d1fb-e9b0-45dc-ab60-7b8db7f76243 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:37.120493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2d1fb-e9b0-45dc-ab60-7b8db7f76243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:37.131640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2d1fb-e9b0-45dc-ab60-7b8db7f76243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:37.135227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2d1fb-e9b0-45dc-ab60-7b8db7f76243 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:37.151406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-d7d2d1fb-e9b0-45dc-ab60-7b8db7f76243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:37.157398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 522/1063] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:37.158831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2e895-8df4-4ec7-842a-b9efee68f77f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:37.250528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2e895-8df4-4ec7-842a-b9efee68f77f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:37.284140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc428b8-80dd-4883-a9e9-4506e99e2dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:37.284796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc428b8-80dd-4883-a9e9-4506e99e2dab None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:37.285080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc428b8-80dd-4883-a9e9-4506e99e2dab None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:37.285354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc428b8-80dd-4883-a9e9-4506e99e2dab None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:37.286062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc428b8-80dd-4883-a9e9-4506e99e2dab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:37.286397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc428b8-80dd-4883-a9e9-4506e99e2dab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:37.288012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc428b8-80dd-4883-a9e9-4506e99e2dab None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:37.306328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 542/1064] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:37.485789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300734b-505e-46ef-9235-aa292fe56153 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:37.486134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300734b-505e-46ef-9235-aa292fe56153 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:37.486394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300734b-505e-46ef-9235-aa292fe56153 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:37.487941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 523/1065] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:37.493047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699e652-7aee-4a99-864c-3c3b65baffb0 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:37.493438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699e652-7aee-4a99-864c-3c3b65baffb0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:37.494225 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699e652-7aee-4a99-864c-3c3b65baffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:37.511477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4699e652-7aee-4a99-864c-3c3b65baffb0 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:37.512668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4699e652-7aee-4a99-864c-3c3b65baffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:37.580623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 543/1066] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:37.603635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300734b-505e-46ef-9235-aa292fe56153 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:37.700450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300734b-505e-46ef-9235-aa292fe56153 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:37.731815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a74d8a-9afb-4af7-9d5c-5b3ffd520b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:37.732621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a74d8a-9afb-4af7-9d5c-5b3ffd520b95 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:37.732926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a74d8a-9afb-4af7-9d5c-5b3ffd520b95 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:37.733197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a74d8a-9afb-4af7-9d5c-5b3ffd520b95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:37.742739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a74d8a-9afb-4af7-9d5c-5b3ffd520b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:37.750702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-b4a74d8a-9afb-4af7-9d5c-5b3ffd520b95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 00:13:37.751875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 524/1067] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 00:13:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:37.759261 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699e652-7aee-4a99-864c-3c3b65baffb0 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:37.851788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699e652-7aee-4a99-864c-3c3b65baffb0 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:37.883618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cc75d-66ee-48de-91e6-c89bd98ce47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:37.884825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cc75d-66ee-48de-91e6-c89bd98ce47f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:37.885102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cc75d-66ee-48de-91e6-c89bd98ce47f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:37.885372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cc75d-66ee-48de-91e6-c89bd98ce47f None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:37.886097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cc75d-66ee-48de-91e6-c89bd98ce47f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:37.886429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cc75d-66ee-48de-91e6-c89bd98ce47f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:37.887762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582cc75d-66ee-48de-91e6-c89bd98ce47f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:37.895195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 544/1068] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 00:13:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:37.900822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a74d8a-9afb-4af7-9d5c-5b3ffd520b95 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:37.994793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a74d8a-9afb-4af7-9d5c-5b3ffd520b95 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:38.025840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ef71-1b43-4288-b2fc-2d627f93c959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:38.026656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ef71-1b43-4288-b2fc-2d627f93c959 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:38.026937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ef71-1b43-4288-b2fc-2d627f93c959 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:38.027208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14ef71-1b43-4288-b2fc-2d627f93c959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:38.037117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14ef71-1b43-4288-b2fc-2d627f93c959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:38.038851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14ef71-1b43-4288-b2fc-2d627f93c959 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:38.054452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-fd14ef71-1b43-4288-b2fc-2d627f93c959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:38.055605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 525/1069] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:38.061857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cc75d-66ee-48de-91e6-c89bd98ce47f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:38.153931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cc75d-66ee-48de-91e6-c89bd98ce47f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:38.190273 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b85db0-584c-46ea-af27-900e2a6f916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:38.190936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b85db0-584c-46ea-af27-900e2a6f916b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:38.191218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b85db0-584c-46ea-af27-900e2a6f916b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:38.191492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b85db0-584c-46ea-af27-900e2a6f916b None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:38.192207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b85db0-584c-46ea-af27-900e2a6f916b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:38.192515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b85db0-584c-46ea-af27-900e2a6f916b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:38.193866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b85db0-584c-46ea-af27-900e2a6f916b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:38.206013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 545/1070] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:38.211379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ef71-1b43-4288-b2fc-2d627f93c959 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:38.309609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14ef71-1b43-4288-b2fc-2d627f93c959 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:38.344593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e37ac-5349-47d8-a28f-7fb0999f28da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:38.345385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e37ac-5349-47d8-a28f-7fb0999f28da None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:38.345670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e37ac-5349-47d8-a28f-7fb0999f28da None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:38.345947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e37ac-5349-47d8-a28f-7fb0999f28da None admin] PATH_INFO: `/v3/users/nova` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:38.353799 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e37ac-5349-47d8-a28f-7fb0999f28da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:38.355270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e37ac-5349-47d8-a28f-7fb0999f28da None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:38.368083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-3b3e37ac-5349-47d8-a28f-7fb0999f28da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 00:13:38.369885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 526/1071] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 00:13:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:38.375647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b85db0-584c-46ea-af27-900e2a6f916b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:38.467522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b85db0-584c-46ea-af27-900e2a6f916b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:38.498842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92f0d2-ff1e-4ba3-8589-35bcb8091f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:38.499506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92f0d2-ff1e-4ba3-8589-35bcb8091f3b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:38.499787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92f0d2-ff1e-4ba3-8589-35bcb8091f3b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:38.500061 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92f0d2-ff1e-4ba3-8589-35bcb8091f3b None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:38.500879 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92f0d2-ff1e-4ba3-8589-35bcb8091f3b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:38.501185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92f0d2-ff1e-4ba3-8589-35bcb8091f3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:38.502668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e92f0d2-ff1e-4ba3-8589-35bcb8091f3b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:38.518883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 546/1072] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 00:13:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:38.525011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e37ac-5349-47d8-a28f-7fb0999f28da None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:38.623516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e37ac-5349-47d8-a28f-7fb0999f28da None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:38.655055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08820-5735-49da-a797-8f6ba64e411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:38.655848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08820-5735-49da-a797-8f6ba64e411e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:38.656127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08820-5735-49da-a797-8f6ba64e411e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:38.656397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e08820-5735-49da-a797-8f6ba64e411e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:38.668293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e08820-5735-49da-a797-8f6ba64e411e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:38.669547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e08820-5735-49da-a797-8f6ba64e411e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:38.685422 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-43e08820-5735-49da-a797-8f6ba64e411e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:38.686623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 527/1073] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:38.692423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92f0d2-ff1e-4ba3-8589-35bcb8091f3b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:38.784727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92f0d2-ff1e-4ba3-8589-35bcb8091f3b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:38.816520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5804c04-97db-4278-b6d0-b5c1f5cf206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:38.817267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5804c04-97db-4278-b6d0-b5c1f5cf206d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:38.817552 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5804c04-97db-4278-b6d0-b5c1f5cf206d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:38.817822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5804c04-97db-4278-b6d0-b5c1f5cf206d None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:38.818559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5804c04-97db-4278-b6d0-b5c1f5cf206d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:38.818860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5804c04-97db-4278-b6d0-b5c1f5cf206d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:38.820193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5804c04-97db-4278-b6d0-b5c1f5cf206d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:38.830830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 547/1074] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:38.836558 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08820-5735-49da-a797-8f6ba64e411e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:38.930276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e08820-5735-49da-a797-8f6ba64e411e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:38.953578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afac69-a91c-4169-b5f9-728646ae749e None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:38.953870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afac69-a91c-4169-b5f9-728646ae749e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:38.954153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afac69-a91c-4169-b5f9-728646ae749e None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:38.955670 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 548/1075] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:38.960314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121555da-f362-407b-bdc6-24154d5ccc93 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:38.960606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121555da-f362-407b-bdc6-24154d5ccc93 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:38.960899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121555da-f362-407b-bdc6-24154d5ccc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:38.963021 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d551c-a4b5-493c-8e5e-1c39d567841d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:38.963814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d551c-a4b5-493c-8e5e-1c39d567841d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:38.964093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d551c-a4b5-493c-8e5e-1c39d567841d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:38.964362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d551c-a4b5-493c-8e5e-1c39d567841d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:38.970825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d551c-a4b5-493c-8e5e-1c39d567841d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:38.972249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d551c-a4b5-493c-8e5e-1c39d567841d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:38.977292 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-121555da-f362-407b-bdc6-24154d5ccc93 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:38.978545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-121555da-f362-407b-bdc6-24154d5ccc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:38.985149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-5f6d551c-a4b5-493c-8e5e-1c39d567841d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:38.986333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 528/1076] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:38.992027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d551c-a4b5-493c-8e5e-1c39d567841d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:39.042746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 549/1077] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:39.065103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121555da-f362-407b-bdc6-24154d5ccc93 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:39.085064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d551c-a4b5-493c-8e5e-1c39d567841d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:39.116784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29264d-f66d-4235-a8e7-915971561a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:39.117432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29264d-f66d-4235-a8e7-915971561a0e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:39.117714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29264d-f66d-4235-a8e7-915971561a0e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:39.117989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29264d-f66d-4235-a8e7-915971561a0e None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:39.118831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29264d-f66d-4235-a8e7-915971561a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:39.119137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29264d-f66d-4235-a8e7-915971561a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:39.120545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29264d-f66d-4235-a8e7-915971561a0e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:39.131360 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 529/1078] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:39.137663 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29264d-f66d-4235-a8e7-915971561a0e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:39.156644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121555da-f362-407b-bdc6-24154d5ccc93 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:39.187969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4bbf3-e376-42fa-ac91-8a842af196b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:39.188692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4bbf3-e376-42fa-ac91-8a842af196b6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:39.188973 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4bbf3-e376-42fa-ac91-8a842af196b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:39.189248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4bbf3-e376-42fa-ac91-8a842af196b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:39.199354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4bbf3-e376-42fa-ac91-8a842af196b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:39.206180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-5ce4bbf3-e376-42fa-ac91-8a842af196b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:13:39.207373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 550/1079] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:39.215146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4bbf3-e376-42fa-ac91-8a842af196b6 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:39.228732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29264d-f66d-4235-a8e7-915971561a0e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:39.260428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d759a-0e6d-403e-845c-1eef7f103449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:39.261296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d759a-0e6d-403e-845c-1eef7f103449 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:39.261571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d759a-0e6d-403e-845c-1eef7f103449 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:39.261840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d759a-0e6d-403e-845c-1eef7f103449 None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/ecf0479293de4edfbf2815c1e9f2f7cc/roles/ed1b3a4e24f2471288b84816ceb586c6` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:39.264016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d759a-0e6d-403e-845c-1eef7f103449 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=ecf0479293de4edfbf2815c1e9f2f7cc, role_id=ed1b3a4e24f2471288b84816ceb586c6)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:39.265424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d759a-0e6d-403e-845c-1eef7f103449 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:39.278073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 530/1080] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:13:39 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/ecf0479293de4edfbf2815c1e9f2f7cc/roles/ed1b3a4e24f2471288b84816ceb586c6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:13:39.311716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4bbf3-e376-42fa-ac91-8a842af196b6 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:39.347061 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd70e6-6d31-407c-8c3c-5965264d7063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:39.347742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd70e6-6d31-407c-8c3c-5965264d7063 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:39.348027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd70e6-6d31-407c-8c3c-5965264d7063 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:39.348303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd70e6-6d31-407c-8c3c-5965264d7063 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:39.349054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd70e6-6d31-407c-8c3c-5965264d7063 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:39.349359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd70e6-6d31-407c-8c3c-5965264d7063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:39.350776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd70e6-6d31-407c-8c3c-5965264d7063 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:39.360865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 551/1081] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:39.366898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d759a-0e6d-403e-845c-1eef7f103449 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:39.469547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d759a-0e6d-403e-845c-1eef7f103449 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:39.500895 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20b582-3794-42e0-967a-c6a81b61c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:39.501760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20b582-3794-42e0-967a-c6a81b61c9ea None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:39.502038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20b582-3794-42e0-967a-c6a81b61c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:39.502336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20b582-3794-42e0-967a-c6a81b61c9ea None admin] PATH_INFO: `/v3/users/eafe08f04a6f4b2ea084a2d2cd2b1ec1` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:39.503526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20b582-3794-42e0-967a-c6a81b61c9ea None admin] RBAC: Authorizing `identity:get_user(user_id=eafe08f04a6f4b2ea084a2d2cd2b1ec1)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:39.504931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20b582-3794-42e0-967a-c6a81b61c9ea None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:39.506571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 531/1082] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:13:39 2022] GET /identity/v3/users/eafe08f04a6f4b2ea084a2d2cd2b1ec1 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:39.512756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd70e6-6d31-407c-8c3c-5965264d7063 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:39.604485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd70e6-6d31-407c-8c3c-5965264d7063 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:39.637001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623408c-ccb9-4a63-bfde-35cd0194298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:39.637859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623408c-ccb9-4a63-bfde-35cd0194298f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:39.638145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623408c-ccb9-4a63-bfde-35cd0194298f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:39.638461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623408c-ccb9-4a63-bfde-35cd0194298f None admin] PATH_INFO: `/v3/projects/b131d2f866a04983b57a0b1a712d2da0` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:39.639607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623408c-ccb9-4a63-bfde-35cd0194298f None admin] RBAC: Authorizing `identity:get_project(project_id=b131d2f866a04983b57a0b1a712d2da0)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:39.641025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623408c-ccb9-4a63-bfde-35cd0194298f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:39.642752 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 552/1083] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:13:39 2022] GET /identity/v3/projects/b131d2f866a04983b57a0b1a712d2da0 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:39.648582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20b582-3794-42e0-967a-c6a81b61c9ea None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:39.742757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20b582-3794-42e0-967a-c6a81b61c9ea None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:39.773595 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c3a4d-5ce2-4eac-ae7d-4aeb35fde3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:39.774530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c3a4d-5ce2-4eac-ae7d-4aeb35fde3c9 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:39.774812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c3a4d-5ce2-4eac-ae7d-4aeb35fde3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:39.775083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c3a4d-5ce2-4eac-ae7d-4aeb35fde3c9 None admin] PATH_INFO: `/v3/projects/b131d2f866a04983b57a0b1a712d2da0/users/eafe08f04a6f4b2ea084a2d2cd2b1ec1/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:39.777013 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c3a4d-5ce2-4eac-ae7d-4aeb35fde3c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b131d2f866a04983b57a0b1a712d2da0, user_id=eafe08f04a6f4b2ea084a2d2cd2b1ec1, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:39.778469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c3a4d-5ce2-4eac-ae7d-4aeb35fde3c9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:39.791331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 532/1084] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:13:39 2022] PUT /identity/v3/projects/b131d2f866a04983b57a0b1a712d2da0/users/eafe08f04a6f4b2ea084a2d2cd2b1ec1/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:41.559915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ee64-f8f3-4981-9281-7bc24f7e6cdb None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:41.560449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ee64-f8f3-4981-9281-7bc24f7e6cdb None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:41.560449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ee64-f8f3-4981-9281-7bc24f7e6cdb None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:41.561789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 553/1085] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:41.566928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82e83a-836f-4d71-a0b8-128534166351 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:41.567361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82e83a-836f-4d71-a0b8-128534166351 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:41.567547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82e83a-836f-4d71-a0b8-128534166351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:41.583602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-7a82e83a-836f-4d71-a0b8-128534166351 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:41.584767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7a82e83a-836f-4d71-a0b8-128534166351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:41.646997 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 533/1086] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:41.673330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ee64-f8f3-4981-9281-7bc24f7e6cdb None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:41.768675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ee64-f8f3-4981-9281-7bc24f7e6cdb None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:41.801002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41e11a-266e-48d1-ae7e-7642f6c80176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:41.801805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41e11a-266e-48d1-ae7e-7642f6c80176 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:41.802086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41e11a-266e-48d1-ae7e-7642f6c80176 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:41.802393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41e11a-266e-48d1-ae7e-7642f6c80176 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:41.812042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41e11a-266e-48d1-ae7e-7642f6c80176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:41.819393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-1e41e11a-266e-48d1-ae7e-7642f6c80176 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 12 00:13:41.820732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 554/1087] 10.222.0.32 () {56 vars in 1120 bytes} [Tue Apr 12 00:13:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:41.826763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82e83a-836f-4d71-a0b8-128534166351 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:41.919360 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82e83a-836f-4d71-a0b8-128534166351 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:41.950862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca42c7e-25d8-47d7-8a88-4793d1b5aa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:41.951518 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca42c7e-25d8-47d7-8a88-4793d1b5aa33 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:41.951801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca42c7e-25d8-47d7-8a88-4793d1b5aa33 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:41.952074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca42c7e-25d8-47d7-8a88-4793d1b5aa33 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:41.952814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca42c7e-25d8-47d7-8a88-4793d1b5aa33 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:41.953114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca42c7e-25d8-47d7-8a88-4793d1b5aa33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:41.954481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca42c7e-25d8-47d7-8a88-4793d1b5aa33 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:41.962013 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 534/1088] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 00:13:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:41.967638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41e11a-266e-48d1-ae7e-7642f6c80176 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.036723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d14713-b877-4272-bbcb-88ad0cbdf0fb None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.037015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d14713-b877-4272-bbcb-88ad0cbdf0fb None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.037298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d14713-b877-4272-bbcb-88ad0cbdf0fb None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.038965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 535/1089] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:13:42.044578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13b35-f019-497b-ba73-590a6c3965f5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.044861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13b35-f019-497b-ba73-590a6c3965f5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.045133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13b35-f019-497b-ba73-590a6c3965f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.061456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6ba13b35-f019-497b-ba73-590a6c3965f5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:42.062703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6ba13b35-f019-497b-ba73-590a6c3965f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:42.062832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41e11a-266e-48d1-ae7e-7642f6c80176 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.093277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a24c9-078e-4736-9d3f-2def4cdc4ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.094055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a24c9-078e-4736-9d3f-2def4cdc4ded None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.094357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a24c9-078e-4736-9d3f-2def4cdc4ded None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.094639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a24c9-078e-4736-9d3f-2def4cdc4ded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.105026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a24c9-078e-4736-9d3f-2def4cdc4ded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:42.106472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a24c9-078e-4736-9d3f-2def4cdc4ded None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:42.122349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-704a24c9-078e-4736-9d3f-2def4cdc4ded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:42.123663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 555/1090] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:42.125005 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 536/1091] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:13:42.129041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a24c9-078e-4736-9d3f-2def4cdc4ded None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.149154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13b35-f019-497b-ba73-590a6c3965f5 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.219903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a24c9-078e-4736-9d3f-2def4cdc4ded None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.244696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13b35-f019-497b-ba73-590a6c3965f5 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.251050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb602-5c24-4fc2-9d9f-6feea84b8496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.251705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb602-5c24-4fc2-9d9f-6feea84b8496 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.251985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb602-5c24-4fc2-9d9f-6feea84b8496 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.252258 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fb602-5c24-4fc2-9d9f-6feea84b8496 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.252967 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fb602-5c24-4fc2-9d9f-6feea84b8496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:42.253267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fb602-5c24-4fc2-9d9f-6feea84b8496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:42.254640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fb602-5c24-4fc2-9d9f-6feea84b8496 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:42.266177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 556/1092] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:42.271617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb602-5c24-4fc2-9d9f-6feea84b8496 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.277362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a01fd2-aeb4-4c88-a705-1783f89f901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.278147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a01fd2-aeb4-4c88-a705-1783f89f901c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.278635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a01fd2-aeb4-4c88-a705-1783f89f901c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.278913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a01fd2-aeb4-4c88-a705-1783f89f901c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.293483 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a01fd2-aeb4-4c88-a705-1783f89f901c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:13:42.300293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-30a01fd2-aeb4-4c88-a705-1783f89f901c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:13:42.301478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 537/1093] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:42.307893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a01fd2-aeb4-4c88-a705-1783f89f901c None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.364322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fb602-5c24-4fc2-9d9f-6feea84b8496 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.397270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018c807-5ece-4124-909f-20cd1adbfe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.398055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018c807-5ece-4124-909f-20cd1adbfe9d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.398360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018c807-5ece-4124-909f-20cd1adbfe9d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.398636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018c807-5ece-4124-909f-20cd1adbfe9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.399432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a01fd2-aeb4-4c88-a705-1783f89f901c None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.405326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018c807-5ece-4124-909f-20cd1adbfe9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:42.406803 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018c807-5ece-4124-909f-20cd1adbfe9d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:42.420237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-a018c807-5ece-4124-909f-20cd1adbfe9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 12 00:13:42.421399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 557/1094] 10.222.0.32 () {56 vars in 1093 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:13:42.427270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018c807-5ece-4124-909f-20cd1adbfe9d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.431208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ad2a-b022-4078-a991-8232797a4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.431880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ad2a-b022-4078-a991-8232797a4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.432163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ad2a-b022-4078-a991-8232797a4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.432436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50ad2a-b022-4078-a991-8232797a4eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.433173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50ad2a-b022-4078-a991-8232797a4eb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:42.433476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50ad2a-b022-4078-a991-8232797a4eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:42.434856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50ad2a-b022-4078-a991-8232797a4eb9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:42.442683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 538/1095] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:42.448754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ad2a-b022-4078-a991-8232797a4eb9 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.519825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018c807-5ece-4124-909f-20cd1adbfe9d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.539499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50ad2a-b022-4078-a991-8232797a4eb9 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.551244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423f1ea-8517-45ad-8e17-101a8454e03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.551907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423f1ea-8517-45ad-8e17-101a8454e03f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.552191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423f1ea-8517-45ad-8e17-101a8454e03f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.552464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423f1ea-8517-45ad-8e17-101a8454e03f None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.553282 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423f1ea-8517-45ad-8e17-101a8454e03f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:42.553590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423f1ea-8517-45ad-8e17-101a8454e03f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:42.555020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423f1ea-8517-45ad-8e17-101a8454e03f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:42.570443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe8412-9aab-42f1-9ffd-788f228770a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.571336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe8412-9aab-42f1-9ffd-788f228770a7 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.572117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe8412-9aab-42f1-9ffd-788f228770a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.572384 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe8412-9aab-42f1-9ffd-788f228770a7 None admin] PATH_INFO: `/v3/users/eafe08f04a6f4b2ea084a2d2cd2b1ec1` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.572643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 558/1096] 10.222.0.32 () {56 vars in 1133 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:42.573568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe8412-9aab-42f1-9ffd-788f228770a7 None admin] RBAC: Authorizing `identity:get_user(user_id=eafe08f04a6f4b2ea084a2d2cd2b1ec1)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:42.575000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe8412-9aab-42f1-9ffd-788f228770a7 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:42.580316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 539/1097] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/users/eafe08f04a6f4b2ea084a2d2cd2b1ec1 => generated 285 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:42.580453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423f1ea-8517-45ad-8e17-101a8454e03f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.582191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe8412-9aab-42f1-9ffd-788f228770a7 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.669509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423f1ea-8517-45ad-8e17-101a8454e03f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.675533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe8412-9aab-42f1-9ffd-788f228770a7 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.701146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5b95e-d1a4-4f4b-854d-453f0bc639fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.701784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5b95e-d1a4-4f4b-854d-453f0bc639fb None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.702064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5b95e-d1a4-4f4b-854d-453f0bc639fb None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.702365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5b95e-d1a4-4f4b-854d-453f0bc639fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.707147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9f658-adf2-403d-9910-adff7b745abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.707791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9f658-adf2-403d-9910-adff7b745abe None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.708076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9f658-adf2-403d-9910-adff7b745abe None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.708352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9f658-adf2-403d-9910-adff7b745abe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.765080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5b95e-d1a4-4f4b-854d-453f0bc639fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:42.766550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5b95e-d1a4-4f4b-854d-453f0bc639fb None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:42.770619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9f658-adf2-403d-9910-adff7b745abe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:42.772038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9f658-adf2-403d-9910-adff7b745abe None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:42.858502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 559/1098] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 00:13:42.863101 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 540/1099] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 00:13:42.868791 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5b95e-d1a4-4f4b-854d-453f0bc639fb None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.869493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9f658-adf2-403d-9910-adff7b745abe None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:42.958596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9f658-adf2-403d-9910-adff7b745abe None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.959018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5b95e-d1a4-4f4b-854d-453f0bc639fb None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:42.989955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b8e6-20e1-4163-9e3c-8ff84a14ad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.990651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b408-99c4-4ae2-a06b-a6b889706d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:42.990830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b8e6-20e1-4163-9e3c-8ff84a14ad80 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.991112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b8e6-20e1-4163-9e3c-8ff84a14ad80 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.991385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258b8e6-20e1-4163-9e3c-8ff84a14ad80 None admin] PATH_INFO: `/v3/projects/b131d2f866a04983b57a0b1a712d2da0` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.991479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b408-99c4-4ae2-a06b-a6b889706d74 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:42.991702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b408-99c4-4ae2-a06b-a6b889706d74 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:42.991977 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328b408-99c4-4ae2-a06b-a6b889706d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:42.992543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258b8e6-20e1-4163-9e3c-8ff84a14ad80 None admin] RBAC: Authorizing `identity:get_project(project_id=b131d2f866a04983b57a0b1a712d2da0)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:42.994602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258b8e6-20e1-4163-9e3c-8ff84a14ad80 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:42.996272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 541/1100] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/projects/b131d2f866a04983b57a0b1a712d2da0 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:43.002117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b8e6-20e1-4163-9e3c-8ff84a14ad80 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:43.002489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328b408-99c4-4ae2-a06b-a6b889706d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:43.003930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328b408-99c4-4ae2-a06b-a6b889706d74 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:43.020910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-3328b408-99c4-4ae2-a06b-a6b889706d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:13:43.022084 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 560/1101] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:43.028342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b408-99c4-4ae2-a06b-a6b889706d74 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:43.097907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258b8e6-20e1-4163-9e3c-8ff84a14ad80 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:43.121478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328b408-99c4-4ae2-a06b-a6b889706d74 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:43.129761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7b324-104e-445d-98dc-6e5ab8f903a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:43.130433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7b324-104e-445d-98dc-6e5ab8f903a5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:43.130714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7b324-104e-445d-98dc-6e5ab8f903a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:43.130988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7b324-104e-445d-98dc-6e5ab8f903a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:43.131818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7b324-104e-445d-98dc-6e5ab8f903a5 None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=b131d2f866a04983b57a0b1a712d2da0, user.id=eafe08f04a6f4b2ea084a2d2cd2b1ec1) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:43.132115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7b324-104e-445d-98dc-6e5ab8f903a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:43.133518 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7b324-104e-445d-98dc-6e5ab8f903a5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:43.150331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 542/1102] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:43 2022] GET /identity/v3/role_assignments?user.id=eafe08f04a6f4b2ea084a2d2cd2b1ec1&scope.project.id=b131d2f866a04983b57a0b1a712d2da0&role.id=f0208c43117c4b799194c83781a46e09 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:43.154271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe439e-d855-4226-bf48-3a4697e6d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:43.154968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe439e-d855-4226-bf48-3a4697e6d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:43.155244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe439e-d855-4226-bf48-3a4697e6d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:43.155514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe439e-d855-4226-bf48-3a4697e6d7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:43.156252 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe439e-d855-4226-bf48-3a4697e6d7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:43.156554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe439e-d855-4226-bf48-3a4697e6d7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:43.157972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe439e-d855-4226-bf48-3a4697e6d7c3 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:43.171091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 561/1103] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:43.177001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7b324-104e-445d-98dc-6e5ab8f903a5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:43.277026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7b324-104e-445d-98dc-6e5ab8f903a5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:43.310541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880801e-4f69-44e2-90e3-6c6dbff2de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:43.311348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880801e-4f69-44e2-90e3-6c6dbff2de41 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:43.311627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880801e-4f69-44e2-90e3-6c6dbff2de41 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:43.311959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880801e-4f69-44e2-90e3-6c6dbff2de41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:43.318897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880801e-4f69-44e2-90e3-6c6dbff2de41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:43.320349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880801e-4f69-44e2-90e3-6c6dbff2de41 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:43.334378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-c880801e-4f69-44e2-90e3-6c6dbff2de41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:13:43.335559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 543/1104] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:13:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:13:43.342164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe439e-d855-4226-bf48-3a4697e6d7c3 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:43.443493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe439e-d855-4226-bf48-3a4697e6d7c3 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:43.475300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94bf7ef-2315-405a-8f3c-bac0d95879de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:43.475960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bf7ef-2315-405a-8f3c-bac0d95879de None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:43.476239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bf7ef-2315-405a-8f3c-bac0d95879de None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:43.476508 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94bf7ef-2315-405a-8f3c-bac0d95879de None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:43.477273 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bf7ef-2315-405a-8f3c-bac0d95879de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:43.477620 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bf7ef-2315-405a-8f3c-bac0d95879de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:43.479054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94bf7ef-2315-405a-8f3c-bac0d95879de None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:43.490380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 562/1105] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:13:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:43.496602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880801e-4f69-44e2-90e3-6c6dbff2de41 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:43.588942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880801e-4f69-44e2-90e3-6c6dbff2de41 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:43.619706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e9c61-353e-4895-90ec-a75685cb7284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:43.620346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9c61-353e-4895-90ec-a75685cb7284 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:43.620622 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9c61-353e-4895-90ec-a75685cb7284 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:43.620890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e9c61-353e-4895-90ec-a75685cb7284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:43.621697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9c61-353e-4895-90ec-a75685cb7284 None admin] RBAC: Adding query filter params (role.id=ed1b3a4e24f2471288b84816ceb586c6, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=ecf0479293de4edfbf2815c1e9f2f7cc) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:43.622003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9c61-353e-4895-90ec-a75685cb7284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:43.623455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e9c61-353e-4895-90ec-a75685cb7284 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:43.628902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 544/1106] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:43 2022] GET /identity/v3/role_assignments?user.id=ecf0479293de4edfbf2815c1e9f2f7cc&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=ed1b3a4e24f2471288b84816ceb586c6 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:45.458683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4d317-21ba-4362-a384-6f1fbc17b464 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:45.459239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4d317-21ba-4362-a384-6f1fbc17b464 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:45.459239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4d317-21ba-4362-a384-6f1fbc17b464 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:45.460595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 563/1107] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:45.466234 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7eba5-331d-4018-8a66-e39a373c99f6 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:45.466648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7eba5-331d-4018-8a66-e39a373c99f6 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:45.466811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7eba5-331d-4018-8a66-e39a373c99f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:45.483317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-7fe7eba5-331d-4018-8a66-e39a373c99f6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:45.484471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7fe7eba5-331d-4018-8a66-e39a373c99f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:45.544855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 545/1108] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:45.570104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4d317-21ba-4362-a384-6f1fbc17b464 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:45.664517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4d317-21ba-4362-a384-6f1fbc17b464 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:45.696355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579aff8-3f10-4912-9122-8a7e11c16334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:45.697126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579aff8-3f10-4912-9122-8a7e11c16334 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:45.697401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579aff8-3f10-4912-9122-8a7e11c16334 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:45.697668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579aff8-3f10-4912-9122-8a7e11c16334 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:45.698823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579aff8-3f10-4912-9122-8a7e11c16334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:45.700220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579aff8-3f10-4912-9122-8a7e11c16334 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:45.701785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 564/1109] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:45.707342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7eba5-331d-4018-8a66-e39a373c99f6 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:45.798140 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7eba5-331d-4018-8a66-e39a373c99f6 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:45.829317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914246b-d9eb-457c-8c37-a4107f35faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:45.829963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914246b-d9eb-457c-8c37-a4107f35faa2 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:45.830242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914246b-d9eb-457c-8c37-a4107f35faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:45.830568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914246b-d9eb-457c-8c37-a4107f35faa2 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:45.831264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914246b-d9eb-457c-8c37-a4107f35faa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:45.832655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a914246b-d9eb-457c-8c37-a4107f35faa2 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:45.852203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 546/1110] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:13:45 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:48.163262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ed0b9-ec0c-4b76-9081-3427e4adc1ef None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:48.163816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ed0b9-ec0c-4b76-9081-3427e4adc1ef None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:48.163816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ed0b9-ec0c-4b76-9081-3427e4adc1ef None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:48.165675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 565/1111] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:48.170755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7a039-4742-4dd7-9916-556288ae19e6 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:48.171175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7a039-4742-4dd7-9916-556288ae19e6 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:48.171319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7a039-4742-4dd7-9916-556288ae19e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:48.188073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b8e7a039-4742-4dd7-9916-556288ae19e6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:48.189245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b8e7a039-4742-4dd7-9916-556288ae19e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:48.251085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 547/1112] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:48.275925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ed0b9-ec0c-4b76-9081-3427e4adc1ef None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:48.369928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ed0b9-ec0c-4b76-9081-3427e4adc1ef None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:48.400819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ea27b-c26c-49a2-94cf-d20ab453afba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:48.401650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ea27b-c26c-49a2-94cf-d20ab453afba None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:48.401930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ea27b-c26c-49a2-94cf-d20ab453afba None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:48.402203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ea27b-c26c-49a2-94cf-d20ab453afba None admin] PATH_INFO: `/v3/roles/3950e5fe56724635b0bd65e6d20fcd1d` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:48.403664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ea27b-c26c-49a2-94cf-d20ab453afba None admin] RBAC: Authorizing `identity:get_role(role_id=3950e5fe56724635b0bd65e6d20fcd1d)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:48.404996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ea27b-c26c-49a2-94cf-d20ab453afba None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:48.406356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 566/1113] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:13:48 2022] GET /identity/v3/roles/3950e5fe56724635b0bd65e6d20fcd1d => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:48.412216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7a039-4742-4dd7-9916-556288ae19e6 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:48.504479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7a039-4742-4dd7-9916-556288ae19e6 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:48.535852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace84d8e-35ef-4f03-a40b-f1e1de96f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:48.536704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace84d8e-35ef-4f03-a40b-f1e1de96f0af None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:48.536989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace84d8e-35ef-4f03-a40b-f1e1de96f0af None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:48.537524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace84d8e-35ef-4f03-a40b-f1e1de96f0af None admin] PATH_INFO: `/v3/users/45527028dd7340229ff2e2ff588eeb7f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:48.550389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace84d8e-35ef-4f03-a40b-f1e1de96f0af None admin] RBAC: Authorizing `identity:get_user(user_id=45527028dd7340229ff2e2ff588eeb7f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:48.551818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace84d8e-35ef-4f03-a40b-f1e1de96f0af None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:48.553429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 548/1114] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:13:48 2022] GET /identity/v3/users/45527028dd7340229ff2e2ff588eeb7f => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:48.558861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ea27b-c26c-49a2-94cf-d20ab453afba None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:48.650415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ea27b-c26c-49a2-94cf-d20ab453afba None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:48.682137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb155d-bae0-4bbf-b5e8-7f750d906e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:48.682797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb155d-bae0-4bbf-b5e8-7f750d906e96 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:48.683083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb155d-bae0-4bbf-b5e8-7f750d906e96 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:48.683356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb155d-bae0-4bbf-b5e8-7f750d906e96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:48.745881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb155d-bae0-4bbf-b5e8-7f750d906e96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:48.747330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb155d-bae0-4bbf-b5e8-7f750d906e96 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:48.838481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 567/1115] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:13:48.844261 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace84d8e-35ef-4f03-a40b-f1e1de96f0af None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:48.936829 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace84d8e-35ef-4f03-a40b-f1e1de96f0af None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:49.092313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29d00e-f023-4b04-8206-c45b9136ebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:49.093070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29d00e-f023-4b04-8206-c45b9136ebc9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:49.093343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29d00e-f023-4b04-8206-c45b9136ebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:49.093606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29d00e-f023-4b04-8206-c45b9136ebc9 None admin] PATH_INFO: `/v3/projects/b131d2f866a04983b57a0b1a712d2da0` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:49.095121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29d00e-f023-4b04-8206-c45b9136ebc9 None admin] RBAC: Authorizing `identity:get_project(project_id=b131d2f866a04983b57a0b1a712d2da0)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:49.096810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b29d00e-f023-4b04-8206-c45b9136ebc9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:49.098478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 549/1116] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:13:48 2022] GET /identity/v3/projects/b131d2f866a04983b57a0b1a712d2da0 => generated 311 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:49.105463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb155d-bae0-4bbf-b5e8-7f750d906e96 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:49.196570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb155d-bae0-4bbf-b5e8-7f750d906e96 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:49.228153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8d3e4-db6c-4422-b9de-9918ac04b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:49.228788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8d3e4-db6c-4422-b9de-9918ac04b22c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:49.229068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8d3e4-db6c-4422-b9de-9918ac04b22c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:49.229341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8d3e4-db6c-4422-b9de-9918ac04b22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:49.230146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8d3e4-db6c-4422-b9de-9918ac04b22c None admin] RBAC: Adding query filter params (role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=b131d2f866a04983b57a0b1a712d2da0, user.id=45527028dd7340229ff2e2ff588eeb7f) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:49.230487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8d3e4-db6c-4422-b9de-9918ac04b22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:49.231875 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8d3e4-db6c-4422-b9de-9918ac04b22c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:49.236982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 568/1117] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:49 2022] GET /identity/v3/role_assignments?user.id=45527028dd7340229ff2e2ff588eeb7f&scope.project.id=b131d2f866a04983b57a0b1a712d2da0&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:51.480381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f530-ce6d-4cc4-b309-c04cab72b4f9 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.480957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f530-ce6d-4cc4-b309-c04cab72b4f9 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.480957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91f530-ce6d-4cc4-b309-c04cab72b4f9 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.482317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 550/1118] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:51.487519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe102f-1182-4530-81ad-3b93bbce5e56 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.487964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe102f-1182-4530-81ad-3b93bbce5e56 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.488058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe102f-1182-4530-81ad-3b93bbce5e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.504419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f1fe102f-1182-4530-81ad-3b93bbce5e56 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:51.505566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f1fe102f-1182-4530-81ad-3b93bbce5e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:51.566665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 569/1119] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:51.589638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91f530-ce6d-4cc4-b309-c04cab72b4f9 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.684495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91f530-ce6d-4cc4-b309-c04cab72b4f9 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.715180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c46b9f-3b9f-4691-8194-a7d44e3f117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.716019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c46b9f-3b9f-4691-8194-a7d44e3f117a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.716301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c46b9f-3b9f-4691-8194-a7d44e3f117a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.716574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c46b9f-3b9f-4691-8194-a7d44e3f117a None admin] PATH_INFO: `/v3/roles/3950e5fe56724635b0bd65e6d20fcd1d` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.718018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c46b9f-3b9f-4691-8194-a7d44e3f117a None admin] RBAC: Authorizing `identity:get_role(role_id=3950e5fe56724635b0bd65e6d20fcd1d)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.719403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c46b9f-3b9f-4691-8194-a7d44e3f117a None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.720737 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 551/1120] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:13:51 2022] GET /identity/v3/roles/3950e5fe56724635b0bd65e6d20fcd1d => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:51.726480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe102f-1182-4530-81ad-3b93bbce5e56 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.816195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe102f-1182-4530-81ad-3b93bbce5e56 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.846477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc7d3c-ada4-4140-a1c1-4973873665d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.847323 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc7d3c-ada4-4140-a1c1-4973873665d6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.847603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc7d3c-ada4-4140-a1c1-4973873665d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.847873 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc7d3c-ada4-4140-a1c1-4973873665d6 None admin] PATH_INFO: `/v3/users/45527028dd7340229ff2e2ff588eeb7f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.849015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc7d3c-ada4-4140-a1c1-4973873665d6 None admin] RBAC: Authorizing `identity:get_user(user_id=45527028dd7340229ff2e2ff588eeb7f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.850430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dc7d3c-ada4-4140-a1c1-4973873665d6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.851989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 570/1121] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:13:51 2022] GET /identity/v3/users/45527028dd7340229ff2e2ff588eeb7f => generated 286 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:51.857863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c46b9f-3b9f-4691-8194-a7d44e3f117a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.949611 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c46b9f-3b9f-4691-8194-a7d44e3f117a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.980987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d25f63-ed76-4e7f-b91c-f8d3fe6ef35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.981815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d25f63-ed76-4e7f-b91c-f8d3fe6ef35e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.982094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d25f63-ed76-4e7f-b91c-f8d3fe6ef35e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.982395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d25f63-ed76-4e7f-b91c-f8d3fe6ef35e None admin] PATH_INFO: `/v3/projects/b131d2f866a04983b57a0b1a712d2da0` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.983556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d25f63-ed76-4e7f-b91c-f8d3fe6ef35e None admin] RBAC: Authorizing `identity:get_project(project_id=b131d2f866a04983b57a0b1a712d2da0)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.984957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d25f63-ed76-4e7f-b91c-f8d3fe6ef35e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.986616 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 552/1122] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:13:51 2022] GET /identity/v3/projects/b131d2f866a04983b57a0b1a712d2da0 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:51.994148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc7d3c-ada4-4140-a1c1-4973873665d6 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:52.084351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dc7d3c-ada4-4140-a1c1-4973873665d6 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:52.115828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e154d1-c93a-4666-906e-08a1c527df21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:52.116690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e154d1-c93a-4666-906e-08a1c527df21 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:52.116967 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e154d1-c93a-4666-906e-08a1c527df21 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:52.117235 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e154d1-c93a-4666-906e-08a1c527df21 None admin] PATH_INFO: `/v3/projects/b131d2f866a04983b57a0b1a712d2da0/users/45527028dd7340229ff2e2ff588eeb7f/roles/3950e5fe56724635b0bd65e6d20fcd1d` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:52.119387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e154d1-c93a-4666-906e-08a1c527df21 None admin] RBAC: Authorizing `identity:create_grant(project_id=b131d2f866a04983b57a0b1a712d2da0, user_id=45527028dd7340229ff2e2ff588eeb7f, role_id=3950e5fe56724635b0bd65e6d20fcd1d)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:52.120776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e154d1-c93a-4666-906e-08a1c527df21 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:52.133538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 571/1123] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:13:51 2022] PUT /identity/v3/projects/b131d2f866a04983b57a0b1a712d2da0/users/45527028dd7340229ff2e2ff588eeb7f/roles/3950e5fe56724635b0bd65e6d20fcd1d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:54.374498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea4070-c6aa-4108-9f39-cbcdd71f0fca None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:54.375037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea4070-c6aa-4108-9f39-cbcdd71f0fca None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:54.375037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea4070-c6aa-4108-9f39-cbcdd71f0fca None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:54.376421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 553/1124] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:54.382083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9baa2e-5b45-4dd6-8798-86e9d0d2599b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:54.382543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9baa2e-5b45-4dd6-8798-86e9d0d2599b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:54.382672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9baa2e-5b45-4dd6-8798-86e9d0d2599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:54.399399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-da9baa2e-5b45-4dd6-8798-86e9d0d2599b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:54.400568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-da9baa2e-5b45-4dd6-8798-86e9d0d2599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:54.463082 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 572/1125] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:54.487077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea4070-c6aa-4108-9f39-cbcdd71f0fca None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:54.581686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea4070-c6aa-4108-9f39-cbcdd71f0fca None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:54.612921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aceafd-9f50-4934-9b94-189d540b1f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:54.613748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aceafd-9f50-4934-9b94-189d540b1f58 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:54.614027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aceafd-9f50-4934-9b94-189d540b1f58 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:54.614318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aceafd-9f50-4934-9b94-189d540b1f58 None admin] PATH_INFO: `/v3/roles/3950e5fe56724635b0bd65e6d20fcd1d` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:54.615779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aceafd-9f50-4934-9b94-189d540b1f58 None admin] RBAC: Authorizing `identity:get_role(role_id=3950e5fe56724635b0bd65e6d20fcd1d)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:54.617139 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aceafd-9f50-4934-9b94-189d540b1f58 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:54.619110 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 554/1126] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:13:54 2022] GET /identity/v3/roles/3950e5fe56724635b0bd65e6d20fcd1d => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:54.624691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9baa2e-5b45-4dd6-8798-86e9d0d2599b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:54.716131 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9baa2e-5b45-4dd6-8798-86e9d0d2599b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:54.748052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d79e40-474a-44d4-85bc-531eed694fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:54.748905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d79e40-474a-44d4-85bc-531eed694fa1 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:54.749185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d79e40-474a-44d4-85bc-531eed694fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:54.749458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d79e40-474a-44d4-85bc-531eed694fa1 None admin] PATH_INFO: `/v3/users/45527028dd7340229ff2e2ff588eeb7f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:54.750645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d79e40-474a-44d4-85bc-531eed694fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=45527028dd7340229ff2e2ff588eeb7f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:54.752048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d79e40-474a-44d4-85bc-531eed694fa1 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:54.753635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 573/1127] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:13:54 2022] GET /identity/v3/users/45527028dd7340229ff2e2ff588eeb7f => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:54.759356 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aceafd-9f50-4934-9b94-189d540b1f58 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:54.851556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aceafd-9f50-4934-9b94-189d540b1f58 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:54.883438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082f391-5530-471e-bc42-097967a48abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:54.884020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f391-5530-471e-bc42-097967a48abb None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:54.884305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f391-5530-471e-bc42-097967a48abb None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:54.884580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082f391-5530-471e-bc42-097967a48abb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:54.946477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082f391-5530-471e-bc42-097967a48abb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:54.947892 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082f391-5530-471e-bc42-097967a48abb None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:55.038915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 555/1128] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:13:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:13:55.045159 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d79e40-474a-44d4-85bc-531eed694fa1 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:55.135499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d79e40-474a-44d4-85bc-531eed694fa1 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:55.167641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0092018-e093-45dc-9125-041cd98ac8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:55.168477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092018-e093-45dc-9125-041cd98ac8c6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:55.168754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092018-e093-45dc-9125-041cd98ac8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:55.169022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0092018-e093-45dc-9125-041cd98ac8c6 None admin] PATH_INFO: `/v3/projects/b131d2f866a04983b57a0b1a712d2da0` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:55.170149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092018-e093-45dc-9125-041cd98ac8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=b131d2f866a04983b57a0b1a712d2da0)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:55.171577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0092018-e093-45dc-9125-041cd98ac8c6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:55.173204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 574/1129] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:13:55 2022] GET /identity/v3/projects/b131d2f866a04983b57a0b1a712d2da0 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:55.179130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082f391-5530-471e-bc42-097967a48abb None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:55.269002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082f391-5530-471e-bc42-097967a48abb None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:55.300438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cd3ea-d098-431d-b755-808223218ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:55.301081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd3ea-d098-431d-b755-808223218ecd None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:55.301364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd3ea-d098-431d-b755-808223218ecd None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:55.301638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cd3ea-d098-431d-b755-808223218ecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:55.302476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cd3ea-d098-431d-b755-808223218ecd None admin] RBAC: Adding query filter params (role.id=3950e5fe56724635b0bd65e6d20fcd1d, scope.project.id=b131d2f866a04983b57a0b1a712d2da0, user.id=45527028dd7340229ff2e2ff588eeb7f) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:55.302789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cd3ea-d098-431d-b755-808223218ecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:55.304186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cd3ea-d098-431d-b755-808223218ecd None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:55.310152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 556/1130] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:13:55 2022] GET /identity/v3/role_assignments?user.id=45527028dd7340229ff2e2ff588eeb7f&scope.project.id=b131d2f866a04983b57a0b1a712d2da0&role.id=3950e5fe56724635b0bd65e6d20fcd1d => generated 608 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:57.597347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c97071-b648-40a2-a059-575b8597fec6 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:57.597883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c97071-b648-40a2-a059-575b8597fec6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:57.597883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c97071-b648-40a2-a059-575b8597fec6 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:57.599372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 575/1131] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:13:57.604526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea16a98-11ef-4685-b61d-4fbc0f9efa59 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:57.604900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea16a98-11ef-4685-b61d-4fbc0f9efa59 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:57.605091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea16a98-11ef-4685-b61d-4fbc0f9efa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:57.621163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6ea16a98-11ef-4685-b61d-4fbc0f9efa59 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:57.622373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6ea16a98-11ef-4685-b61d-4fbc0f9efa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:57.685297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 557/1132] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:13:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:13:57.710424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c97071-b648-40a2-a059-575b8597fec6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:57.804752 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c97071-b648-40a2-a059-575b8597fec6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:57.836955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef9f86-9778-4ceb-95e7-74c34211762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:57.837737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef9f86-9778-4ceb-95e7-74c34211762b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:57.838022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef9f86-9778-4ceb-95e7-74c34211762b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:57.838330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef9f86-9778-4ceb-95e7-74c34211762b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:57.839482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef9f86-9778-4ceb-95e7-74c34211762b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:57.840892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef9f86-9778-4ceb-95e7-74c34211762b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:57.842499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 576/1133] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:13:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:57.848238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea16a98-11ef-4685-b61d-4fbc0f9efa59 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:57.939830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea16a98-11ef-4685-b61d-4fbc0f9efa59 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:57.970537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac4cbb-2d5e-49b1-a3c5-c94786f35347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:57.971176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4cbb-2d5e-49b1-a3c5-c94786f35347 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:57.971456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4cbb-2d5e-49b1-a3c5-c94786f35347 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:57.971725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac4cbb-2d5e-49b1-a3c5-c94786f35347 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:57.972423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac4cbb-2d5e-49b1-a3c5-c94786f35347 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:57.973822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac4cbb-2d5e-49b1-a3c5-c94786f35347 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:57.997826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 558/1134] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:13:57 2022] POST /identity/v3/projects => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:14:00.297231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c9dac-30d3-430b-a49d-16a3a32c4d5a None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:00.297808 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c9dac-30d3-430b-a49d-16a3a32c4d5a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:00.297808 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c9dac-30d3-430b-a49d-16a3a32c4d5a None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:00.299172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 577/1135] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:00.304350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa132-7a2b-45c8-b587-a47b788c9d6c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:00.304749 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa132-7a2b-45c8-b587-a47b788c9d6c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:00.305406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fa132-7a2b-45c8-b587-a47b788c9d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:00.321950 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-382fa132-7a2b-45c8-b587-a47b788c9d6c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:00.323137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-382fa132-7a2b-45c8-b587-a47b788c9d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:00.386714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 559/1136] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:00.412455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c9dac-30d3-430b-a49d-16a3a32c4d5a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:00.509331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c9dac-30d3-430b-a49d-16a3a32c4d5a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:00.540526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508719b-849e-4340-a7fb-0eeeca411c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:00.541308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508719b-849e-4340-a7fb-0eeeca411c34 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:00.541593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508719b-849e-4340-a7fb-0eeeca411c34 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:00.541870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508719b-849e-4340-a7fb-0eeeca411c34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:00.543056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508719b-849e-4340-a7fb-0eeeca411c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:00.544474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508719b-849e-4340-a7fb-0eeeca411c34 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:00.546064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 578/1137] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:14:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:00.551842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fa132-7a2b-45c8-b587-a47b788c9d6c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:00.643668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fa132-7a2b-45c8-b587-a47b788c9d6c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:00.675554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7c64f-6483-464a-bab7-1d49980b5e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:00.676218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c64f-6483-464a-bab7-1d49980b5e34 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:00.676502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c64f-6483-464a-bab7-1d49980b5e34 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:00.676779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c64f-6483-464a-bab7-1d49980b5e34 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:00.677486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7c64f-6483-464a-bab7-1d49980b5e34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:00.679017 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b7c64f-6483-464a-bab7-1d49980b5e34 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:00.698529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 560/1138] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:14:00 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:02.995241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823948e-4a9f-4c57-aa8f-11ebb93c25ee None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:02.995760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823948e-4a9f-4c57-aa8f-11ebb93c25ee None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:02.995760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823948e-4a9f-4c57-aa8f-11ebb93c25ee None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:02.997142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 579/1139] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:03.002159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245f814-7e50-497a-9035-7dc6ab236548 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:03.002597 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245f814-7e50-497a-9035-7dc6ab236548 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:03.002812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245f814-7e50-497a-9035-7dc6ab236548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:03.019454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d245f814-7e50-497a-9035-7dc6ab236548 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:03.020632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d245f814-7e50-497a-9035-7dc6ab236548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:03.082709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 561/1140] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:03.108165 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823948e-4a9f-4c57-aa8f-11ebb93c25ee None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:03.201349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823948e-4a9f-4c57-aa8f-11ebb93c25ee None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:03.232381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0cf3c-49ed-46e5-80d0-404a6260f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:03.233149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0cf3c-49ed-46e5-80d0-404a6260f0da None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:03.233426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0cf3c-49ed-46e5-80d0-404a6260f0da None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:03.233694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0cf3c-49ed-46e5-80d0-404a6260f0da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:03.243577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf0cf3c-49ed-46e5-80d0-404a6260f0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:14:03.250369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-1cf0cf3c-49ed-46e5-80d0-404a6260f0da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:14:03.251468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 580/1141] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:14:03.257470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245f814-7e50-497a-9035-7dc6ab236548 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:03.349145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245f814-7e50-497a-9035-7dc6ab236548 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:03.380543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2f19-4eb3-4a38-b57d-0fc842536073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:03.381200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2f19-4eb3-4a38-b57d-0fc842536073 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:03.381482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2f19-4eb3-4a38-b57d-0fc842536073 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:03.381757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c2f19-4eb3-4a38-b57d-0fc842536073 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:03.382525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c2f19-4eb3-4a38-b57d-0fc842536073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:03.382829 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c2f19-4eb3-4a38-b57d-0fc842536073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:03.384730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c2f19-4eb3-4a38-b57d-0fc842536073 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:03.392280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 562/1142] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:14:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:03.397967 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0cf3c-49ed-46e5-80d0-404a6260f0da None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:03.491111 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf0cf3c-49ed-46e5-80d0-404a6260f0da None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:03.522989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c870-7c35-4ca0-87b6-3fa39355bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:03.523805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c870-7c35-4ca0-87b6-3fa39355bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:03.524089 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c870-7c35-4ca0-87b6-3fa39355bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:03.524366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c870-7c35-4ca0-87b6-3fa39355bcb7 None admin] PATH_INFO: `/v3/users/5a0c7ebc2f0b4cc4afd565aca11e136b` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:03.536713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216c870-7c35-4ca0-87b6-3fa39355bcb7 None admin] RBAC: Authorizing `identity:get_user(user_id=5a0c7ebc2f0b4cc4afd565aca11e136b)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:03.538441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216c870-7c35-4ca0-87b6-3fa39355bcb7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:03.540060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 581/1143] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:14:03 2022] GET /identity/v3/users/5a0c7ebc2f0b4cc4afd565aca11e136b => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:03.545544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2f19-4eb3-4a38-b57d-0fc842536073 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:03.637197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c2f19-4eb3-4a38-b57d-0fc842536073 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:03.668660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42c793-ad82-4298-97ce-8e7a5d52468b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:03.669301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42c793-ad82-4298-97ce-8e7a5d52468b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:03.669592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42c793-ad82-4298-97ce-8e7a5d52468b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:03.669868 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42c793-ad82-4298-97ce-8e7a5d52468b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:03.731878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42c793-ad82-4298-97ce-8e7a5d52468b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:03.733301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42c793-ad82-4298-97ce-8e7a5d52468b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:03.823609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 563/1144] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:14:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:14:03.829473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c870-7c35-4ca0-87b6-3fa39355bcb7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:03.920937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216c870-7c35-4ca0-87b6-3fa39355bcb7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:03.952096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0e26d-625e-4799-bd48-8330f907c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:03.952936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0e26d-625e-4799-bd48-8330f907c711 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:03.953219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0e26d-625e-4799-bd48-8330f907c711 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:03.953494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0e26d-625e-4799-bd48-8330f907c711 None admin] PATH_INFO: `/v3/projects/49b4a4d1491e4f2d8a460a8acb1e210f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:03.954663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0e26d-625e-4799-bd48-8330f907c711 None admin] RBAC: Authorizing `identity:get_project(project_id=49b4a4d1491e4f2d8a460a8acb1e210f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:03.956066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0e26d-625e-4799-bd48-8330f907c711 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:03.957701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 582/1145] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:14:03 2022] GET /identity/v3/projects/49b4a4d1491e4f2d8a460a8acb1e210f => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:03.964080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42c793-ad82-4298-97ce-8e7a5d52468b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:04.055431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42c793-ad82-4298-97ce-8e7a5d52468b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:04.086925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78095403-fe3e-43fe-a2d1-56e87a222d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:04.087504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095403-fe3e-43fe-a2d1-56e87a222d8c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:04.087786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095403-fe3e-43fe-a2d1-56e87a222d8c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:04.088060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095403-fe3e-43fe-a2d1-56e87a222d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:04.088869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78095403-fe3e-43fe-a2d1-56e87a222d8c None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=49b4a4d1491e4f2d8a460a8acb1e210f, user.id=5a0c7ebc2f0b4cc4afd565aca11e136b) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:04.089178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78095403-fe3e-43fe-a2d1-56e87a222d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:04.090601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78095403-fe3e-43fe-a2d1-56e87a222d8c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:04.095681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 564/1146] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:14:03 2022] GET /identity/v3/role_assignments?user.id=5a0c7ebc2f0b4cc4afd565aca11e136b&scope.project.id=49b4a4d1491e4f2d8a460a8acb1e210f&role.id=f0208c43117c4b799194c83781a46e09 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:06.348282 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2055549-add0-459d-afd7-21432b2c3610 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:06.348863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2055549-add0-459d-afd7-21432b2c3610 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:06.348863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2055549-add0-459d-afd7-21432b2c3610 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:06.350189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 583/1147] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:06.356095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a77019-4577-42e5-b719-1e0d3fe449de None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:06.356488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a77019-4577-42e5-b719-1e0d3fe449de None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:06.356651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a77019-4577-42e5-b719-1e0d3fe449de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:06.372726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-05a77019-4577-42e5-b719-1e0d3fe449de None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:06.373890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-05a77019-4577-42e5-b719-1e0d3fe449de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:06.434831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 565/1148] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:06.457193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2055549-add0-459d-afd7-21432b2c3610 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:06.553039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2055549-add0-459d-afd7-21432b2c3610 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:06.583978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ff09-d9d5-4dbe-b8a6-64f6d9880a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:06.584751 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ff09-d9d5-4dbe-b8a6-64f6d9880a84 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:06.585035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ff09-d9d5-4dbe-b8a6-64f6d9880a84 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:06.585309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ff09-d9d5-4dbe-b8a6-64f6d9880a84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:06.595453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015ff09-d9d5-4dbe-b8a6-64f6d9880a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:14:06.602509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-0015ff09-d9d5-4dbe-b8a6-64f6d9880a84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:14:06.603618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 584/1149] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:14:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:14:06.610805 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a77019-4577-42e5-b719-1e0d3fe449de None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:06.701917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a77019-4577-42e5-b719-1e0d3fe449de None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:06.732863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72540760-ab04-4fc1-b557-b6c50ff28e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:06.733513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540760-ab04-4fc1-b557-b6c50ff28e30 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:06.733792 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540760-ab04-4fc1-b557-b6c50ff28e30 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:06.734061 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540760-ab04-4fc1-b557-b6c50ff28e30 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:06.734818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540760-ab04-4fc1-b557-b6c50ff28e30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:06.735118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540760-ab04-4fc1-b557-b6c50ff28e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:06.736466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540760-ab04-4fc1-b557-b6c50ff28e30 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:06.743906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 566/1150] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:14:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:06.749613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ff09-d9d5-4dbe-b8a6-64f6d9880a84 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:06.843940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ff09-d9d5-4dbe-b8a6-64f6d9880a84 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:06.874511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95328b-52ab-4626-99d3-31115489d2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:06.875300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95328b-52ab-4626-99d3-31115489d2ed None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:06.875588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95328b-52ab-4626-99d3-31115489d2ed None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:06.875866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95328b-52ab-4626-99d3-31115489d2ed None admin] PATH_INFO: `/v3/users/5a0c7ebc2f0b4cc4afd565aca11e136b` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:06.877030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95328b-52ab-4626-99d3-31115489d2ed None admin] RBAC: Authorizing `identity:get_user(user_id=5a0c7ebc2f0b4cc4afd565aca11e136b)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:06.878467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95328b-52ab-4626-99d3-31115489d2ed None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:06.880045 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 585/1151] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:14:06 2022] GET /identity/v3/users/5a0c7ebc2f0b4cc4afd565aca11e136b => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:06.885906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72540760-ab04-4fc1-b557-b6c50ff28e30 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:06.976882 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72540760-ab04-4fc1-b557-b6c50ff28e30 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:07.007394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626dd067-b1a4-4afb-92ae-7220be93eb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:07.008806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dd067-b1a4-4afb-92ae-7220be93eb95 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:07.009077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dd067-b1a4-4afb-92ae-7220be93eb95 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:07.009344 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626dd067-b1a4-4afb-92ae-7220be93eb95 None admin] PATH_INFO: `/v3/projects/49b4a4d1491e4f2d8a460a8acb1e210f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:07.010505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dd067-b1a4-4afb-92ae-7220be93eb95 None admin] RBAC: Authorizing `identity:get_project(project_id=49b4a4d1491e4f2d8a460a8acb1e210f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:07.011902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626dd067-b1a4-4afb-92ae-7220be93eb95 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:07.013515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 567/1152] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:14:06 2022] GET /identity/v3/projects/49b4a4d1491e4f2d8a460a8acb1e210f => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:07.019187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95328b-52ab-4626-99d3-31115489d2ed None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:07.111475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95328b-52ab-4626-99d3-31115489d2ed None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:07.143046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba76ec-655a-4686-8ac0-6ae50a8c7c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:07.143854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba76ec-655a-4686-8ac0-6ae50a8c7c17 None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:07.144135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba76ec-655a-4686-8ac0-6ae50a8c7c17 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:07.144409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba76ec-655a-4686-8ac0-6ae50a8c7c17 None admin] PATH_INFO: `/v3/projects/49b4a4d1491e4f2d8a460a8acb1e210f/users/5a0c7ebc2f0b4cc4afd565aca11e136b/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:07.146350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba76ec-655a-4686-8ac0-6ae50a8c7c17 None admin] RBAC: Authorizing `identity:create_grant(project_id=49b4a4d1491e4f2d8a460a8acb1e210f, user_id=5a0c7ebc2f0b4cc4afd565aca11e136b, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:07.147742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba76ec-655a-4686-8ac0-6ae50a8c7c17 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:07.159581 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 586/1153] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:14:07 2022] PUT /identity/v3/projects/49b4a4d1491e4f2d8a460a8acb1e210f/users/5a0c7ebc2f0b4cc4afd565aca11e136b/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:09.397849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadebe0-9ab6-4ff6-b451-d3639faa20d1 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:09.398984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadebe0-9ab6-4ff6-b451-d3639faa20d1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:09.398984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadebe0-9ab6-4ff6-b451-d3639faa20d1 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:09.400312 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 568/1154] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:09.405361 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01d41f-d1a9-4962-ae65-3b34c933919c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:09.405745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01d41f-d1a9-4962-ae65-3b34c933919c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:09.405926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01d41f-d1a9-4962-ae65-3b34c933919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:09.422924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-da01d41f-d1a9-4962-ae65-3b34c933919c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:09.424112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-da01d41f-d1a9-4962-ae65-3b34c933919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:09.487357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 587/1155] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:09.511407 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadebe0-9ab6-4ff6-b451-d3639faa20d1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:09.605351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadebe0-9ab6-4ff6-b451-d3639faa20d1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:09.636371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb98a6-3175-4649-bc79-0ffa1b8adc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:09.637136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb98a6-3175-4649-bc79-0ffa1b8adc4e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:09.637413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb98a6-3175-4649-bc79-0ffa1b8adc4e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:09.637683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb98a6-3175-4649-bc79-0ffa1b8adc4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:09.647055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb98a6-3175-4649-bc79-0ffa1b8adc4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:14:09.654486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-2beb98a6-3175-4649-bc79-0ffa1b8adc4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:14:09.655582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 569/1156] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:14:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:14:09.661479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01d41f-d1a9-4962-ae65-3b34c933919c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:09.752317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01d41f-d1a9-4962-ae65-3b34c933919c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:09.783846 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e086b-3252-4f59-bb0a-b66aa304f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:09.784491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e086b-3252-4f59-bb0a-b66aa304f204 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:09.784769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e086b-3252-4f59-bb0a-b66aa304f204 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:09.785036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e086b-3252-4f59-bb0a-b66aa304f204 None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:09.785760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e086b-3252-4f59-bb0a-b66aa304f204 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:09.786056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e086b-3252-4f59-bb0a-b66aa304f204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:09.787684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e086b-3252-4f59-bb0a-b66aa304f204 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:09.795152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 588/1157] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:09.800905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb98a6-3175-4649-bc79-0ffa1b8adc4e None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:09.892920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb98a6-3175-4649-bc79-0ffa1b8adc4e None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:09.924450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc7d65-a32f-440d-bf07-a520c76d66bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:09.925241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc7d65-a32f-440d-bf07-a520c76d66bd None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:09.925523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc7d65-a32f-440d-bf07-a520c76d66bd None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:09.925796 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc7d65-a32f-440d-bf07-a520c76d66bd None admin] PATH_INFO: `/v3/users/5a0c7ebc2f0b4cc4afd565aca11e136b` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:09.926988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc7d65-a32f-440d-bf07-a520c76d66bd None admin] RBAC: Authorizing `identity:get_user(user_id=5a0c7ebc2f0b4cc4afd565aca11e136b)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:09.928397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc7d65-a32f-440d-bf07-a520c76d66bd None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:09.930034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 570/1158] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:14:09 2022] GET /identity/v3/users/5a0c7ebc2f0b4cc4afd565aca11e136b => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:09.935587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e086b-3252-4f59-bb0a-b66aa304f204 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:10.029270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e086b-3252-4f59-bb0a-b66aa304f204 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:10.060287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6039aa3-33b4-4c8e-b6c2-f041a2791bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:10.060909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6039aa3-33b4-4c8e-b6c2-f041a2791bae None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:10.061187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6039aa3-33b4-4c8e-b6c2-f041a2791bae None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:10.061459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6039aa3-33b4-4c8e-b6c2-f041a2791bae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:10.122907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6039aa3-33b4-4c8e-b6c2-f041a2791bae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:10.124304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6039aa3-33b4-4c8e-b6c2-f041a2791bae None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:10.214682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 589/1159] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:14:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:14:10.220299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc7d65-a32f-440d-bf07-a520c76d66bd None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:10.312577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc7d65-a32f-440d-bf07-a520c76d66bd None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:10.343729 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568359b-9f9a-4369-943b-cdf7c18026de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:10.344566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568359b-9f9a-4369-943b-cdf7c18026de None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:10.344849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568359b-9f9a-4369-943b-cdf7c18026de None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:10.345122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568359b-9f9a-4369-943b-cdf7c18026de None admin] PATH_INFO: `/v3/projects/49b4a4d1491e4f2d8a460a8acb1e210f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:10.346291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568359b-9f9a-4369-943b-cdf7c18026de None admin] RBAC: Authorizing `identity:get_project(project_id=49b4a4d1491e4f2d8a460a8acb1e210f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:10.347699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568359b-9f9a-4369-943b-cdf7c18026de None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:10.349335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 571/1160] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:14:10 2022] GET /identity/v3/projects/49b4a4d1491e4f2d8a460a8acb1e210f => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:10.355679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6039aa3-33b4-4c8e-b6c2-f041a2791bae None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:10.446886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6039aa3-33b4-4c8e-b6c2-f041a2791bae None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:10.478351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483d2fc-63d2-4fcf-965e-bbb38415e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:10.478940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483d2fc-63d2-4fcf-965e-bbb38415e5c5 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:10.479222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483d2fc-63d2-4fcf-965e-bbb38415e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:10.479492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483d2fc-63d2-4fcf-965e-bbb38415e5c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:10.480306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483d2fc-63d2-4fcf-965e-bbb38415e5c5 None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=49b4a4d1491e4f2d8a460a8acb1e210f, user.id=5a0c7ebc2f0b4cc4afd565aca11e136b) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:10.480611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483d2fc-63d2-4fcf-965e-bbb38415e5c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:10.482008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483d2fc-63d2-4fcf-965e-bbb38415e5c5 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:10.487467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 590/1161] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:14:10 2022] GET /identity/v3/role_assignments?user.id=5a0c7ebc2f0b4cc4afd565aca11e136b&scope.project.id=49b4a4d1491e4f2d8a460a8acb1e210f&role.id=f0208c43117c4b799194c83781a46e09 => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:12.751345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735554f-9aa2-43b4-b245-4ad51ac89d31 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:12.751828 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735554f-9aa2-43b4-b245-4ad51ac89d31 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:12.751929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735554f-9aa2-43b4-b245-4ad51ac89d31 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:12.753258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 572/1162] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:12.758321 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06448b6-0b55-499d-8081-0c30491fe20f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:12.758726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06448b6-0b55-499d-8081-0c30491fe20f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:12.758874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06448b6-0b55-499d-8081-0c30491fe20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:12.774930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f06448b6-0b55-499d-8081-0c30491fe20f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:12.776072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f06448b6-0b55-499d-8081-0c30491fe20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:12.837371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 591/1163] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:12.859068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735554f-9aa2-43b4-b245-4ad51ac89d31 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:12.952882 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735554f-9aa2-43b4-b245-4ad51ac89d31 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:12.983394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd55d9-0ddd-45dc-9e07-fc1ad1d8fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:12.984016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd55d9-0ddd-45dc-9e07-fc1ad1d8fb2d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:12.984297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd55d9-0ddd-45dc-9e07-fc1ad1d8fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:12.984570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd55d9-0ddd-45dc-9e07-fc1ad1d8fb2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:13.045302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd55d9-0ddd-45dc-9e07-fc1ad1d8fb2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:13.046747 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd55d9-0ddd-45dc-9e07-fc1ad1d8fb2d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:13.136593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 573/1164] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:14:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:14:13.143715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06448b6-0b55-499d-8081-0c30491fe20f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:13.233070 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06448b6-0b55-499d-8081-0c30491fe20f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:13.265268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dd6b8-6789-4157-b8ce-e961ea3fa548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:13.266046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dd6b8-6789-4157-b8ce-e961ea3fa548 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:13.266350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dd6b8-6789-4157-b8ce-e961ea3fa548 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:13.266622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dd6b8-6789-4157-b8ce-e961ea3fa548 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:13.272834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dd6b8-6789-4157-b8ce-e961ea3fa548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:13.274285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dd6b8-6789-4157-b8ce-e961ea3fa548 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:13.287996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-419dd6b8-6789-4157-b8ce-e961ea3fa548 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 12 00:14:13.289152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 592/1165] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:14:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:14:13.295143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd55d9-0ddd-45dc-9e07-fc1ad1d8fb2d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:13.387533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd55d9-0ddd-45dc-9e07-fc1ad1d8fb2d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:13.419114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997d8de-3db0-425d-b461-93ffa59f0359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:13.419757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997d8de-3db0-425d-b461-93ffa59f0359 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:13.420038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997d8de-3db0-425d-b461-93ffa59f0359 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:13.420312 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997d8de-3db0-425d-b461-93ffa59f0359 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:13.421024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997d8de-3db0-425d-b461-93ffa59f0359 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:13.421326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997d8de-3db0-425d-b461-93ffa59f0359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:13.422715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997d8de-3db0-425d-b461-93ffa59f0359 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:13.430080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 574/1166] 10.222.0.32 () {56 vars in 1115 bytes} [Tue Apr 12 00:14:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:15.684718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8019dd1-9330-4e3c-ba70-323efa287e2c None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:15.685185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8019dd1-9330-4e3c-ba70-323efa287e2c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:15.685300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8019dd1-9330-4e3c-ba70-323efa287e2c None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:15.686684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 593/1167] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:15.691821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201ccc-2a47-42d7-8b1a-465212de5021 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:15.692235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201ccc-2a47-42d7-8b1a-465212de5021 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:15.692384 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32201ccc-2a47-42d7-8b1a-465212de5021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:15.708503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-32201ccc-2a47-42d7-8b1a-465212de5021 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:15.709674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-32201ccc-2a47-42d7-8b1a-465212de5021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:15.771589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 575/1168] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:14:15.799405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8019dd1-9330-4e3c-ba70-323efa287e2c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:15.894305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8019dd1-9330-4e3c-ba70-323efa287e2c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:15.925595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5813c-4deb-4797-a553-657a4bdf9729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:15.926184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5813c-4deb-4797-a553-657a4bdf9729 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:15.926496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5813c-4deb-4797-a553-657a4bdf9729 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:15.926773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5813c-4deb-4797-a553-657a4bdf9729 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:15.927502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5813c-4deb-4797-a553-657a4bdf9729 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:15.928844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5813c-4deb-4797-a553-657a4bdf9729 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:15.943046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 594/1169] 10.222.0.32 () {60 vars in 1138 bytes} [Tue Apr 12 00:14:15 2022] POST /identity/v3/domains => generated 267 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:18.257861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d382c-38bc-4a1f-9a5f-f64ee4ea97d1 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:18.258420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d382c-38bc-4a1f-9a5f-f64ee4ea97d1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:18.258510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d382c-38bc-4a1f-9a5f-f64ee4ea97d1 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:18.259820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 576/1170] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:18.265017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6f6ac-e0ae-41ee-ae02-ed63ee159af9 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:18.265435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6f6ac-e0ae-41ee-ae02-ed63ee159af9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:18.265572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6f6ac-e0ae-41ee-ae02-ed63ee159af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:18.282054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-01e6f6ac-e0ae-41ee-ae02-ed63ee159af9 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:18.283230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-01e6f6ac-e0ae-41ee-ae02-ed63ee159af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:18.344101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 595/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:18.368697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d382c-38bc-4a1f-9a5f-f64ee4ea97d1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:18.462154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d382c-38bc-4a1f-9a5f-f64ee4ea97d1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:18.493556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca03357-2841-472e-8781-ce2f15adc05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:18.494432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03357-2841-472e-8781-ce2f15adc05c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:18.494717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03357-2841-472e-8781-ce2f15adc05c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:18.494992 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca03357-2841-472e-8781-ce2f15adc05c None admin] PATH_INFO: `/v3/domains/4976b8e15043481b88adf26f35a83140` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:18.504727 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03357-2841-472e-8781-ce2f15adc05c None admin] RBAC: Authorizing `identity:get_domain(domain_id=4976b8e15043481b88adf26f35a83140)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:18.506157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca03357-2841-472e-8781-ce2f15adc05c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:18.507839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 577/1172] 10.222.0.32 () {56 vars in 1183 bytes} [Tue Apr 12 00:14:18 2022] GET /identity/v3/domains/4976b8e15043481b88adf26f35a83140 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:18.513718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6f6ac-e0ae-41ee-ae02-ed63ee159af9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:18.605256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6f6ac-e0ae-41ee-ae02-ed63ee159af9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:18.636231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e29ced-ddc8-4664-a22b-2c5b1d3ba382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:18.636870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29ced-ddc8-4664-a22b-2c5b1d3ba382 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:18.637151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29ced-ddc8-4664-a22b-2c5b1d3ba382 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:18.637425 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29ced-ddc8-4664-a22b-2c5b1d3ba382 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:18.638119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e29ced-ddc8-4664-a22b-2c5b1d3ba382 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:18.639548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e29ced-ddc8-4664-a22b-2c5b1d3ba382 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:18.664388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 596/1173] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:14:18 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:14:20.959214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8c29a-dfc8-4c6b-a6f4-df95e809d975 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:20.959740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8c29a-dfc8-4c6b-a6f4-df95e809d975 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:20.959834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8c29a-dfc8-4c6b-a6f4-df95e809d975 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:20.961884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 578/1174] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:20.967027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fc6e-2b15-4d36-a79e-af4d71818936 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:20.967417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fc6e-2b15-4d36-a79e-af4d71818936 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:20.967592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68fc6e-2b15-4d36-a79e-af4d71818936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:20.983753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5f68fc6e-2b15-4d36-a79e-af4d71818936 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:20.984919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5f68fc6e-2b15-4d36-a79e-af4d71818936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:21.047100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 597/1175] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:21.072587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8c29a-dfc8-4c6b-a6f4-df95e809d975 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:21.165740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8c29a-dfc8-4c6b-a6f4-df95e809d975 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:21.197426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cb69a-94bf-4200-b431-f53cae4eede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:21.198275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cb69a-94bf-4200-b431-f53cae4eede5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:21.198578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cb69a-94bf-4200-b431-f53cae4eede5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:21.198849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cb69a-94bf-4200-b431-f53cae4eede5 None admin] PATH_INFO: `/v3/domains/4976b8e15043481b88adf26f35a83140` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:21.199986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cb69a-94bf-4200-b431-f53cae4eede5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4976b8e15043481b88adf26f35a83140)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:21.201381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cb69a-94bf-4200-b431-f53cae4eede5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:21.202983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 579/1176] 10.222.0.32 () {56 vars in 1183 bytes} [Tue Apr 12 00:14:21 2022] GET /identity/v3/domains/4976b8e15043481b88adf26f35a83140 => generated 267 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:21.208532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68fc6e-2b15-4d36-a79e-af4d71818936 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:21.300150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68fc6e-2b15-4d36-a79e-af4d71818936 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:21.333266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917f9cd-617a-40e5-a418-d8c79e877c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:21.333923 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f9cd-617a-40e5-a418-d8c79e877c22 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:21.334213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f9cd-617a-40e5-a418-d8c79e877c22 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:21.334520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917f9cd-617a-40e5-a418-d8c79e877c22 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:21.335215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917f9cd-617a-40e5-a418-d8c79e877c22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:21.336705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917f9cd-617a-40e5-a418-d8c79e877c22 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:21.356723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 598/1177] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:14:21 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:23.644702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666af4c-38c0-4daa-b75f-d96f56a7a8e2 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:23.645229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666af4c-38c0-4daa-b75f-d96f56a7a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:23.645229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666af4c-38c0-4daa-b75f-d96f56a7a8e2 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:23.646631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 580/1178] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:23.651842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595aaa-a4f2-43fa-84da-3b031400176c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:23.652240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595aaa-a4f2-43fa-84da-3b031400176c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:23.652392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc595aaa-a4f2-43fa-84da-3b031400176c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:23.669558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-dc595aaa-a4f2-43fa-84da-3b031400176c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:23.670746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-dc595aaa-a4f2-43fa-84da-3b031400176c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:23.732786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 599/1179] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:23.757676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666af4c-38c0-4daa-b75f-d96f56a7a8e2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:23.852741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666af4c-38c0-4daa-b75f-d96f56a7a8e2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:23.883982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96c370-6cf1-45c1-990a-4cadb0da1f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:23.884756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96c370-6cf1-45c1-990a-4cadb0da1f2a None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:23.885037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96c370-6cf1-45c1-990a-4cadb0da1f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:23.885312 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96c370-6cf1-45c1-990a-4cadb0da1f2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:23.894698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96c370-6cf1-45c1-990a-4cadb0da1f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:14:23.901586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-5d96c370-6cf1-45c1-990a-4cadb0da1f2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:14:23.902702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 581/1180] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:14:23.908592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595aaa-a4f2-43fa-84da-3b031400176c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:24.000887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc595aaa-a4f2-43fa-84da-3b031400176c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:24.031858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198ab7a-5f56-43f7-b556-97adff77c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:24.032511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198ab7a-5f56-43f7-b556-97adff77c12f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:24.032797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198ab7a-5f56-43f7-b556-97adff77c12f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:24.033071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198ab7a-5f56-43f7-b556-97adff77c12f None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:24.033800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198ab7a-5f56-43f7-b556-97adff77c12f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:24.034105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198ab7a-5f56-43f7-b556-97adff77c12f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:24.035502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198ab7a-5f56-43f7-b556-97adff77c12f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:24.043818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 600/1181] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:24.049391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96c370-6cf1-45c1-990a-4cadb0da1f2a None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:24.141884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96c370-6cf1-45c1-990a-4cadb0da1f2a None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:24.173054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccf298-db01-47b9-8743-fa08bb044842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:24.173845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccf298-db01-47b9-8743-fa08bb044842 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:24.174124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccf298-db01-47b9-8743-fa08bb044842 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:24.174591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccf298-db01-47b9-8743-fa08bb044842 None admin] PATH_INFO: `/v3/users/702b922a50ae43d4878d5bc2b125ed78` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:24.187397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccf298-db01-47b9-8743-fa08bb044842 None admin] RBAC: Authorizing `identity:get_user(user_id=702b922a50ae43d4878d5bc2b125ed78)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:24.188817 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccf298-db01-47b9-8743-fa08bb044842 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:24.190432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 582/1182] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:14:24 2022] GET /identity/v3/users/702b922a50ae43d4878d5bc2b125ed78 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:24.195928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198ab7a-5f56-43f7-b556-97adff77c12f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:24.288903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198ab7a-5f56-43f7-b556-97adff77c12f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:24.321327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c920980-6eba-4347-8c16-1a97e63d9fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:24.322161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c920980-6eba-4347-8c16-1a97e63d9fa7 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:24.322657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c920980-6eba-4347-8c16-1a97e63d9fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:24.323051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c920980-6eba-4347-8c16-1a97e63d9fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:24.386506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c920980-6eba-4347-8c16-1a97e63d9fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:24.387933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c920980-6eba-4347-8c16-1a97e63d9fa7 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:24.479472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 601/1183] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:14:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:14:24.485330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccf298-db01-47b9-8743-fa08bb044842 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:24.576283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccf298-db01-47b9-8743-fa08bb044842 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:24.607834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f37e5-3e46-4720-91f9-9ae491a86d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:24.608666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f37e5-3e46-4720-91f9-9ae491a86d7b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:24.608944 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f37e5-3e46-4720-91f9-9ae491a86d7b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:24.609213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f37e5-3e46-4720-91f9-9ae491a86d7b None admin] PATH_INFO: `/v3/projects/6ac18d054d34462f99acc8d43de1d063` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:24.610388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f37e5-3e46-4720-91f9-9ae491a86d7b None admin] RBAC: Authorizing `identity:get_project(project_id=6ac18d054d34462f99acc8d43de1d063)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:24.611784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f37e5-3e46-4720-91f9-9ae491a86d7b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:24.613416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 583/1184] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:14:24 2022] GET /identity/v3/projects/6ac18d054d34462f99acc8d43de1d063 => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:24.619415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c920980-6eba-4347-8c16-1a97e63d9fa7 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:24.712419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c920980-6eba-4347-8c16-1a97e63d9fa7 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:24.743050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035daf05-d36c-4f7a-999d-b4cbc681915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:24.743629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035daf05-d36c-4f7a-999d-b4cbc681915c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:24.743910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035daf05-d36c-4f7a-999d-b4cbc681915c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:24.744183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035daf05-d36c-4f7a-999d-b4cbc681915c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:24.744989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035daf05-d36c-4f7a-999d-b4cbc681915c None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=6ac18d054d34462f99acc8d43de1d063, user.id=702b922a50ae43d4878d5bc2b125ed78) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:24.745295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035daf05-d36c-4f7a-999d-b4cbc681915c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:24.746741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035daf05-d36c-4f7a-999d-b4cbc681915c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:24.751814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 602/1185] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:14:24 2022] GET /identity/v3/role_assignments?user.id=702b922a50ae43d4878d5bc2b125ed78&scope.project.id=6ac18d054d34462f99acc8d43de1d063&role.id=f0208c43117c4b799194c83781a46e09 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:26.990226 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d52adf-7dde-414b-a27a-955247858bdd None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:26.990770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d52adf-7dde-414b-a27a-955247858bdd None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:26.990883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d52adf-7dde-414b-a27a-955247858bdd None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:26.992161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 584/1186] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:26.997255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c0439-bab0-416e-b4ee-bed5ac1f5209 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:26.997640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c0439-bab0-416e-b4ee-bed5ac1f5209 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:26.997807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c0439-bab0-416e-b4ee-bed5ac1f5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:27.014391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f49c0439-bab0-416e-b4ee-bed5ac1f5209 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:27.015539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f49c0439-bab0-416e-b4ee-bed5ac1f5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:27.076852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 603/1187] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:27.098757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d52adf-7dde-414b-a27a-955247858bdd None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:27.191240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d52adf-7dde-414b-a27a-955247858bdd None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:27.222753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efe397-f76b-4423-8167-c941d82e84d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:27.223519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efe397-f76b-4423-8167-c941d82e84d1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:27.223797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efe397-f76b-4423-8167-c941d82e84d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:27.224066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efe397-f76b-4423-8167-c941d82e84d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:27.233433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efe397-f76b-4423-8167-c941d82e84d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:14:27.240203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-c2efe397-f76b-4423-8167-c941d82e84d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:14:27.241908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 585/1188] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:14:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:14:27.249034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c0439-bab0-416e-b4ee-bed5ac1f5209 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:27.341041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c0439-bab0-416e-b4ee-bed5ac1f5209 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:27.372512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a330d50-f48d-4cce-af9b-58b8715c3cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:27.373156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a330d50-f48d-4cce-af9b-58b8715c3cdd None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:27.373438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a330d50-f48d-4cce-af9b-58b8715c3cdd None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:27.373711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a330d50-f48d-4cce-af9b-58b8715c3cdd None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:27.374466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a330d50-f48d-4cce-af9b-58b8715c3cdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:27.374770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a330d50-f48d-4cce-af9b-58b8715c3cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:27.376115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a330d50-f48d-4cce-af9b-58b8715c3cdd None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:27.383607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 604/1189] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:14:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:27.389295 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efe397-f76b-4423-8167-c941d82e84d1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:27.482439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efe397-f76b-4423-8167-c941d82e84d1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:27.513090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c169023-9277-469f-ac00-50514bce4b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:27.513874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c169023-9277-469f-ac00-50514bce4b68 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:27.514153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c169023-9277-469f-ac00-50514bce4b68 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:27.514592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c169023-9277-469f-ac00-50514bce4b68 None admin] PATH_INFO: `/v3/users/702b922a50ae43d4878d5bc2b125ed78` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:27.515746 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c169023-9277-469f-ac00-50514bce4b68 None admin] RBAC: Authorizing `identity:get_user(user_id=702b922a50ae43d4878d5bc2b125ed78)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:27.517140 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c169023-9277-469f-ac00-50514bce4b68 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:27.518730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 586/1190] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:14:27 2022] GET /identity/v3/users/702b922a50ae43d4878d5bc2b125ed78 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:27.524757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a330d50-f48d-4cce-af9b-58b8715c3cdd None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:27.617205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a330d50-f48d-4cce-af9b-58b8715c3cdd None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:27.648626 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35444d-97e7-4c2d-afd8-5b0c6ff25c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:27.649460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35444d-97e7-4c2d-afd8-5b0c6ff25c6a None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:27.649739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35444d-97e7-4c2d-afd8-5b0c6ff25c6a None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:27.650009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35444d-97e7-4c2d-afd8-5b0c6ff25c6a None admin] PATH_INFO: `/v3/projects/6ac18d054d34462f99acc8d43de1d063` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:27.651194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35444d-97e7-4c2d-afd8-5b0c6ff25c6a None admin] RBAC: Authorizing `identity:get_project(project_id=6ac18d054d34462f99acc8d43de1d063)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:27.652595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35444d-97e7-4c2d-afd8-5b0c6ff25c6a None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:27.654237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 605/1191] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:14:27 2022] GET /identity/v3/projects/6ac18d054d34462f99acc8d43de1d063 => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:27.659894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c169023-9277-469f-ac00-50514bce4b68 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:27.752973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c169023-9277-469f-ac00-50514bce4b68 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:27.784470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90338424-dbdf-44a1-b1f0-5ce7ca5419b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:27.785282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90338424-dbdf-44a1-b1f0-5ce7ca5419b4 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:27.785563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90338424-dbdf-44a1-b1f0-5ce7ca5419b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:27.785835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90338424-dbdf-44a1-b1f0-5ce7ca5419b4 None admin] PATH_INFO: `/v3/projects/6ac18d054d34462f99acc8d43de1d063/users/702b922a50ae43d4878d5bc2b125ed78/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:27.788039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90338424-dbdf-44a1-b1f0-5ce7ca5419b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ac18d054d34462f99acc8d43de1d063, user_id=702b922a50ae43d4878d5bc2b125ed78, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:27.789719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90338424-dbdf-44a1-b1f0-5ce7ca5419b4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:27.802670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 587/1192] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:14:27 2022] PUT /identity/v3/projects/6ac18d054d34462f99acc8d43de1d063/users/702b922a50ae43d4878d5bc2b125ed78/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:30.047272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9e80-9903-4f20-98f7-853533ceb1ff None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:30.047819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9e80-9903-4f20-98f7-853533ceb1ff None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:30.047819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc9e80-9903-4f20-98f7-853533ceb1ff None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:30.049169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 606/1193] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:14:30.054789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0129fb2-6bc3-4969-8c06-eacfc922b8b2 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:30.055190 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0129fb2-6bc3-4969-8c06-eacfc922b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:30.055349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0129fb2-6bc3-4969-8c06-eacfc922b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:30.071426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b0129fb2-6bc3-4969-8c06-eacfc922b8b2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:30.072591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b0129fb2-6bc3-4969-8c06-eacfc922b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:30.134387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 588/1194] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:14:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:14:30.158404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc9e80-9903-4f20-98f7-853533ceb1ff None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:30.252391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc9e80-9903-4f20-98f7-853533ceb1ff None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:30.283800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691418-8c3a-466d-81cb-66cd4622ea3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:30.284606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691418-8c3a-466d-81cb-66cd4622ea3b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:30.284886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691418-8c3a-466d-81cb-66cd4622ea3b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:30.285159 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691418-8c3a-466d-81cb-66cd4622ea3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:30.295612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a691418-8c3a-466d-81cb-66cd4622ea3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:14:30.302485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-4a691418-8c3a-466d-81cb-66cd4622ea3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:14:30.303589 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 607/1195] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:14:30.309469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0129fb2-6bc3-4969-8c06-eacfc922b8b2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:30.400476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0129fb2-6bc3-4969-8c06-eacfc922b8b2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:30.437008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5638c-8d8a-4734-947a-962699657654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:30.437656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5638c-8d8a-4734-947a-962699657654 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:30.437936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5638c-8d8a-4734-947a-962699657654 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:30.438209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5638c-8d8a-4734-947a-962699657654 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:30.438977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5638c-8d8a-4734-947a-962699657654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:30.439278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5638c-8d8a-4734-947a-962699657654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:30.440623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5638c-8d8a-4734-947a-962699657654 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:30.448152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 589/1196] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:30.453792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691418-8c3a-466d-81cb-66cd4622ea3b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:30.546788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691418-8c3a-466d-81cb-66cd4622ea3b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:30.577329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e430-a901-45f5-adee-86572e2ad8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:30.578118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e430-a901-45f5-adee-86572e2ad8b1 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:30.578431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e430-a901-45f5-adee-86572e2ad8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:30.578705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e430-a901-45f5-adee-86572e2ad8b1 None admin] PATH_INFO: `/v3/users/702b922a50ae43d4878d5bc2b125ed78` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:30.579853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e430-a901-45f5-adee-86572e2ad8b1 None admin] RBAC: Authorizing `identity:get_user(user_id=702b922a50ae43d4878d5bc2b125ed78)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:30.581251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e430-a901-45f5-adee-86572e2ad8b1 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:30.582864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 608/1197] 10.222.0.32 () {56 vars in 1177 bytes} [Tue Apr 12 00:14:30 2022] GET /identity/v3/users/702b922a50ae43d4878d5bc2b125ed78 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:30.589097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5638c-8d8a-4734-947a-962699657654 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:30.681672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5638c-8d8a-4734-947a-962699657654 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:30.713219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c07fb-eb11-4dad-a916-5fbe602c599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:30.713850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c07fb-eb11-4dad-a916-5fbe602c599d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:30.714128 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c07fb-eb11-4dad-a916-5fbe602c599d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:30.714423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c07fb-eb11-4dad-a916-5fbe602c599d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:30.780352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c07fb-eb11-4dad-a916-5fbe602c599d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:30.781774 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c07fb-eb11-4dad-a916-5fbe602c599d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:30.872476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 590/1198] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:14:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:14:30.878359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e430-a901-45f5-adee-86572e2ad8b1 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:30.971763 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e430-a901-45f5-adee-86572e2ad8b1 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:31.002732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de21541-1211-4cfe-9093-c0954a9c1d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:31.003577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de21541-1211-4cfe-9093-c0954a9c1d39 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:31.003859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de21541-1211-4cfe-9093-c0954a9c1d39 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:31.004138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de21541-1211-4cfe-9093-c0954a9c1d39 None admin] PATH_INFO: `/v3/projects/6ac18d054d34462f99acc8d43de1d063` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:31.005288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de21541-1211-4cfe-9093-c0954a9c1d39 None admin] RBAC: Authorizing `identity:get_project(project_id=6ac18d054d34462f99acc8d43de1d063)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:31.006778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de21541-1211-4cfe-9093-c0954a9c1d39 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:31.008429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 609/1199] 10.222.0.32 () {56 vars in 1186 bytes} [Tue Apr 12 00:14:30 2022] GET /identity/v3/projects/6ac18d054d34462f99acc8d43de1d063 => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:31.014178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c07fb-eb11-4dad-a916-5fbe602c599d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:31.106617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c07fb-eb11-4dad-a916-5fbe602c599d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:31.138351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb152dd-0eca-4206-9190-5d97f6156a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:31.138940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb152dd-0eca-4206-9190-5d97f6156a5c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:31.139220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb152dd-0eca-4206-9190-5d97f6156a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:31.139495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb152dd-0eca-4206-9190-5d97f6156a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:31.140310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb152dd-0eca-4206-9190-5d97f6156a5c None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=6ac18d054d34462f99acc8d43de1d063, user.id=702b922a50ae43d4878d5bc2b125ed78) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:31.140621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb152dd-0eca-4206-9190-5d97f6156a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:31.142021 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb152dd-0eca-4206-9190-5d97f6156a5c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:31.148058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 591/1200] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:14:31 2022] GET /identity/v3/role_assignments?user.id=702b922a50ae43d4878d5bc2b125ed78&scope.project.id=6ac18d054d34462f99acc8d43de1d063&role.id=f0208c43117c4b799194c83781a46e09 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:32.530517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe1a18-dc44-4e94-8351-50cf5219de62 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:32.531129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe1a18-dc44-4e94-8351-50cf5219de62 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:32.531129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe1a18-dc44-4e94-8351-50cf5219de62 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:32.532570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 610/1201] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:15:32.540215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78427e39-05ef-40e6-8ecf-b3f8f70565ea None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:32.540680 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78427e39-05ef-40e6-8ecf-b3f8f70565ea None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:32.540808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78427e39-05ef-40e6-8ecf-b3f8f70565ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:32.563406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-78427e39-05ef-40e6-8ecf-b3f8f70565ea None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:15:32.564596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-78427e39-05ef-40e6-8ecf-b3f8f70565ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:32.658309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 592/1202] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:15:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:15:32.681391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe1a18-dc44-4e94-8351-50cf5219de62 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:32.809623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe1a18-dc44-4e94-8351-50cf5219de62 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:32.850212 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7e89a-35f8-42ae-947c-a9cfd0274c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:32.851307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7e89a-35f8-42ae-947c-a9cfd0274c1f None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:32.851751 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7e89a-35f8-42ae-947c-a9cfd0274c1f None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:32.852182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7e89a-35f8-42ae-947c-a9cfd0274c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:32.863276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7e89a-35f8-42ae-947c-a9cfd0274c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:32.865432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7e89a-35f8-42ae-947c-a9cfd0274c1f None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:32.888257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2ad7e89a-35f8-42ae-947c-a9cfd0274c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:32.889533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 611/1203] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:32.896954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78427e39-05ef-40e6-8ecf-b3f8f70565ea None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:33.041304 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78427e39-05ef-40e6-8ecf-b3f8f70565ea None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:33.087983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b76dec-27f4-4065-bdd5-1fd849f3e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:33.089127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b76dec-27f4-4065-bdd5-1fd849f3e4db None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:33.089537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b76dec-27f4-4065-bdd5-1fd849f3e4db None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:33.090016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b76dec-27f4-4065-bdd5-1fd849f3e4db None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:33.091339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b76dec-27f4-4065-bdd5-1fd849f3e4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:33.091875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b76dec-27f4-4065-bdd5-1fd849f3e4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:33.094449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b76dec-27f4-4065-bdd5-1fd849f3e4db None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:33.107898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 593/1204] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:33.113311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7e89a-35f8-42ae-947c-a9cfd0274c1f None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:33.237270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7e89a-35f8-42ae-947c-a9cfd0274c1f None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:33.275730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca8ec2-033b-4901-a28d-54378295b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:33.276579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca8ec2-033b-4901-a28d-54378295b5f1 None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:33.276756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca8ec2-033b-4901-a28d-54378295b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:33.276990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca8ec2-033b-4901-a28d-54378295b5f1 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:33.277706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca8ec2-033b-4901-a28d-54378295b5f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:33.279287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca8ec2-033b-4901-a28d-54378295b5f1 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:33.301221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 612/1205] 10.222.0.32 () {60 vars in 1132 bytes} [Tue Apr 12 00:15:33 2022] POST /identity/v3/users => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:15:35.831015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8998ca-f8b1-4790-8f92-141551bef3dd None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:35.831615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8998ca-f8b1-4790-8f92-141551bef3dd None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:35.831615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8998ca-f8b1-4790-8f92-141551bef3dd None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:35.833351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 594/1206] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:15:35.840736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1e1f0-57ea-489d-b3f9-dcb301d33e73 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:35.840736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1e1f0-57ea-489d-b3f9-dcb301d33e73 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:35.840736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1e1f0-57ea-489d-b3f9-dcb301d33e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:35.857468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d0a1e1f0-57ea-489d-b3f9-dcb301d33e73 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:15:35.858739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d0a1e1f0-57ea-489d-b3f9-dcb301d33e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:35.928294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 613/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:15:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:15:35.955583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8998ca-f8b1-4790-8f92-141551bef3dd None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:36.070283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8998ca-f8b1-4790-8f92-141551bef3dd None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:36.106951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401faca-d5aa-464c-bc6f-31e58fd6cca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:36.107778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401faca-d5aa-464c-bc6f-31e58fd6cca5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:36.108029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401faca-d5aa-464c-bc6f-31e58fd6cca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:36.108300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401faca-d5aa-464c-bc6f-31e58fd6cca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:36.122113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401faca-d5aa-464c-bc6f-31e58fd6cca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:15:36.130357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-f401faca-d5aa-464c-bc6f-31e58fd6cca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:15:36.136580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 595/1208] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:15:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:36.139101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1e1f0-57ea-489d-b3f9-dcb301d33e73 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:36.243459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1e1f0-57ea-489d-b3f9-dcb301d33e73 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:36.288503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b404a93-21fa-4a03-9096-3109db765aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:36.289521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b404a93-21fa-4a03-9096-3109db765aaf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:36.290203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b404a93-21fa-4a03-9096-3109db765aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:36.290799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b404a93-21fa-4a03-9096-3109db765aaf None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:36.291821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b404a93-21fa-4a03-9096-3109db765aaf None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:36.292294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b404a93-21fa-4a03-9096-3109db765aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:36.294486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b404a93-21fa-4a03-9096-3109db765aaf None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:36.305233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 614/1209] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:15:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:36.312519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401faca-d5aa-464c-bc6f-31e58fd6cca5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:36.436416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401faca-d5aa-464c-bc6f-31e58fd6cca5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:36.486037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacb111-ee45-4064-a3a0-eda31b759ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:36.487068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacb111-ee45-4064-a3a0-eda31b759ab5 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:36.487491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacb111-ee45-4064-a3a0-eda31b759ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:36.487816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacb111-ee45-4064-a3a0-eda31b759ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:36.502338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacb111-ee45-4064-a3a0-eda31b759ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:36.504767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacb111-ee45-4064-a3a0-eda31b759ab5 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:36.522090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-fbacb111-ee45-4064-a3a0-eda31b759ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:36.523535 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 596/1210] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:36.529985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b404a93-21fa-4a03-9096-3109db765aaf None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:36.643983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b404a93-21fa-4a03-9096-3109db765aaf None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:36.680421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0733f6-5daf-437e-bf99-b6e5c7e52d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:36.681265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0733f6-5daf-437e-bf99-b6e5c7e52d8c None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:36.681648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0733f6-5daf-437e-bf99-b6e5c7e52d8c None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:36.682024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0733f6-5daf-437e-bf99-b6e5c7e52d8c None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:36.682869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0733f6-5daf-437e-bf99-b6e5c7e52d8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:36.683272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0733f6-5daf-437e-bf99-b6e5c7e52d8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:36.684729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0733f6-5daf-437e-bf99-b6e5c7e52d8c None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:36.699640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 615/1211] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:36.705822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacb111-ee45-4064-a3a0-eda31b759ab5 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:36.812810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacb111-ee45-4064-a3a0-eda31b759ab5 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:36.846940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861011b-7d97-4df0-a1c0-444caf5da4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:36.847779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861011b-7d97-4df0-a1c0-444caf5da4be None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:36.848095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861011b-7d97-4df0-a1c0-444caf5da4be None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:36.848397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861011b-7d97-4df0-a1c0-444caf5da4be None admin] PATH_INFO: `/v3/users/placement` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:36.856000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861011b-7d97-4df0-a1c0-444caf5da4be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:36.857463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861011b-7d97-4df0-a1c0-444caf5da4be None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:36.871484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-d861011b-7d97-4df0-a1c0-444caf5da4be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 00:15:36.877472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 597/1212] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:36.878663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0733f6-5daf-437e-bf99-b6e5c7e52d8c None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:36.983082 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0733f6-5daf-437e-bf99-b6e5c7e52d8c None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:37.022116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc875be-ba50-4f52-ba1f-f2d696b71acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:37.022781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc875be-ba50-4f52-ba1f-f2d696b71acf None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:37.023063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc875be-ba50-4f52-ba1f-f2d696b71acf None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:37.023334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc875be-ba50-4f52-ba1f-f2d696b71acf None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:37.024161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc875be-ba50-4f52-ba1f-f2d696b71acf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:37.024468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc875be-ba50-4f52-ba1f-f2d696b71acf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:37.025900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc875be-ba50-4f52-ba1f-f2d696b71acf None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:37.045063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 616/1213] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 00:15:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:37.052072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861011b-7d97-4df0-a1c0-444caf5da4be None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:37.157704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861011b-7d97-4df0-a1c0-444caf5da4be None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:37.191808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7e8c6-023d-4b9a-8851-7f8f358f8cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:37.192460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7e8c6-023d-4b9a-8851-7f8f358f8cd1 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:37.192746 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7e8c6-023d-4b9a-8851-7f8f358f8cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:37.193022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7e8c6-023d-4b9a-8851-7f8f358f8cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:37.265297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7e8c6-023d-4b9a-8851-7f8f358f8cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:37.266843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7e8c6-023d-4b9a-8851-7f8f358f8cd1 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:37.384146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 598/1214] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:15:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 00:15:37.389859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc875be-ba50-4f52-ba1f-f2d696b71acf None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:37.500288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc875be-ba50-4f52-ba1f-f2d696b71acf None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:37.536609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a55c35-8b50-42fd-9170-65a589f2bfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:37.537416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a55c35-8b50-42fd-9170-65a589f2bfe6 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:37.537703 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a55c35-8b50-42fd-9170-65a589f2bfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:37.537982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a55c35-8b50-42fd-9170-65a589f2bfe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:37.549273 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a55c35-8b50-42fd-9170-65a589f2bfe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:37.550961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a55c35-8b50-42fd-9170-65a589f2bfe6 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:37.569832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-21a55c35-8b50-42fd-9170-65a589f2bfe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:37.571087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 617/1215] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:15:37.577643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7e8c6-023d-4b9a-8851-7f8f358f8cd1 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:37.699363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7e8c6-023d-4b9a-8851-7f8f358f8cd1 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:37.743536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789a4b3-2133-44fa-a86f-f47406ccbc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:37.744293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789a4b3-2133-44fa-a86f-f47406ccbc95 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:37.744633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789a4b3-2133-44fa-a86f-f47406ccbc95 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:37.744985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789a4b3-2133-44fa-a86f-f47406ccbc95 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:37.745931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789a4b3-2133-44fa-a86f-f47406ccbc95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:37.746301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789a4b3-2133-44fa-a86f-f47406ccbc95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:37.747862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789a4b3-2133-44fa-a86f-f47406ccbc95 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:37.768075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 599/1216] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:37.770375 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a55c35-8b50-42fd-9170-65a589f2bfe6 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:37.880828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a55c35-8b50-42fd-9170-65a589f2bfe6 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:37.916161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c960be5-5e76-475f-a8b8-8f07213777be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:37.916945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960be5-5e76-475f-a8b8-8f07213777be None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:37.917228 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960be5-5e76-475f-a8b8-8f07213777be None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:37.917506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c960be5-5e76-475f-a8b8-8f07213777be None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:37.924341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c960be5-5e76-475f-a8b8-8f07213777be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:37.926387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c960be5-5e76-475f-a8b8-8f07213777be None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:37.939772 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-9c960be5-5e76-475f-a8b8-8f07213777be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:15:37.941097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 618/1217] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:15:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:37.947550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789a4b3-2133-44fa-a86f-f47406ccbc95 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:38.059517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789a4b3-2133-44fa-a86f-f47406ccbc95 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:38.099187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65033ce-75a7-4ade-9a85-3096080f872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:38.100008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65033ce-75a7-4ade-9a85-3096080f872c None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:38.100318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65033ce-75a7-4ade-9a85-3096080f872c None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:38.100733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65033ce-75a7-4ade-9a85-3096080f872c None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:38.101617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65033ce-75a7-4ade-9a85-3096080f872c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:38.101928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65033ce-75a7-4ade-9a85-3096080f872c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:38.103540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65033ce-75a7-4ade-9a85-3096080f872c None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:38.118983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 600/1218] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:15:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:38.125034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c960be5-5e76-475f-a8b8-8f07213777be None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:38.232899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c960be5-5e76-475f-a8b8-8f07213777be None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:38.271127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a5378-319b-4065-b18f-c3a1b0b39f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:38.271926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a5378-319b-4065-b18f-c3a1b0b39f93 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:38.272308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a5378-319b-4065-b18f-c3a1b0b39f93 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:38.272679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a5378-319b-4065-b18f-c3a1b0b39f93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:38.273644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a5378-319b-4065-b18f-c3a1b0b39f93 None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=92588782f32a472193340aba2bff8d78) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:38.274007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a5378-319b-4065-b18f-c3a1b0b39f93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:38.275594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a5378-319b-4065-b18f-c3a1b0b39f93 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:38.281550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 619/1219] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:15:38 2022] GET /identity/v3/role_assignments?user.id=92588782f32a472193340aba2bff8d78&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:15:40.652480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb2bd8-7946-425e-9931-6aaa09fa5e76 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:40.653043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb2bd8-7946-425e-9931-6aaa09fa5e76 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:40.653043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb2bd8-7946-425e-9931-6aaa09fa5e76 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:40.654508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 601/1220] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:15:40.667851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ff750-d206-4a18-90ef-4a9ca191a012 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:40.668308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ff750-d206-4a18-90ef-4a9ca191a012 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:40.668394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ff750-d206-4a18-90ef-4a9ca191a012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:40.687391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0d2ff750-d206-4a18-90ef-4a9ca191a012 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:15:40.688622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0d2ff750-d206-4a18-90ef-4a9ca191a012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:40.759992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 620/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:15:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:15:40.785939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb2bd8-7946-425e-9931-6aaa09fa5e76 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:40.892220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb2bd8-7946-425e-9931-6aaa09fa5e76 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:40.927448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a0bd7-2354-447c-8ea8-4985665a9ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:40.928216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0bd7-2354-447c-8ea8-4985665a9ce9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:40.928440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0bd7-2354-447c-8ea8-4985665a9ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:40.928713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0bd7-2354-447c-8ea8-4985665a9ce9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:40.938697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a0bd7-2354-447c-8ea8-4985665a9ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:15:40.945629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-df8a0bd7-2354-447c-8ea8-4985665a9ce9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:15:40.946838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 602/1222] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:15:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:40.954621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ff750-d206-4a18-90ef-4a9ca191a012 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:41.056766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ff750-d206-4a18-90ef-4a9ca191a012 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:41.090452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1beed3-8f41-4f90-9d8f-8e08a0e6dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:41.091293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1beed3-8f41-4f90-9d8f-8e08a0e6dc0e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:41.091636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1beed3-8f41-4f90-9d8f-8e08a0e6dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:41.092077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1beed3-8f41-4f90-9d8f-8e08a0e6dc0e None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:41.092985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1beed3-8f41-4f90-9d8f-8e08a0e6dc0e None admin] RBAC: Adding query filter params (name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:41.093315 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1beed3-8f41-4f90-9d8f-8e08a0e6dc0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:41.094853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1beed3-8f41-4f90-9d8f-8e08a0e6dc0e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:41.104414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 621/1223] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:15:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:41.110493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a0bd7-2354-447c-8ea8-4985665a9ce9 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:41.207542 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a0bd7-2354-447c-8ea8-4985665a9ce9 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:41.241998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937db19-daca-4606-baaf-94f03d8716ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:41.243059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937db19-daca-4606-baaf-94f03d8716ff None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:41.243436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937db19-daca-4606-baaf-94f03d8716ff None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:41.243795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937db19-daca-4606-baaf-94f03d8716ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:41.255318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937db19-daca-4606-baaf-94f03d8716ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:41.256750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937db19-daca-4606-baaf-94f03d8716ff None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:41.275084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-2937db19-daca-4606-baaf-94f03d8716ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:41.276466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 603/1224] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:41.282656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1beed3-8f41-4f90-9d8f-8e08a0e6dc0e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:41.396162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1beed3-8f41-4f90-9d8f-8e08a0e6dc0e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:41.429959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802abb64-131a-4579-9228-2bf107c11e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:41.430655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802abb64-131a-4579-9228-2bf107c11e1b None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:41.431707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802abb64-131a-4579-9228-2bf107c11e1b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:41.431707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802abb64-131a-4579-9228-2bf107c11e1b None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:41.431913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802abb64-131a-4579-9228-2bf107c11e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:41.432211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802abb64-131a-4579-9228-2bf107c11e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:41.433658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802abb64-131a-4579-9228-2bf107c11e1b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:41.445670 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 622/1225] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:41.451484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937db19-daca-4606-baaf-94f03d8716ff None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:41.557258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937db19-daca-4606-baaf-94f03d8716ff None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:41.595627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8b60c-a3ec-46cc-97e4-2da9519a33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:41.596600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8b60c-a3ec-46cc-97e4-2da9519a33e7 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:41.597041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8b60c-a3ec-46cc-97e4-2da9519a33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:41.597270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8b60c-a3ec-46cc-97e4-2da9519a33e7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:41.607975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8b60c-a3ec-46cc-97e4-2da9519a33e7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:41.609995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8b60c-a3ec-46cc-97e4-2da9519a33e7 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:41.625869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-46a8b60c-a3ec-46cc-97e4-2da9519a33e7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 00:15:41.627093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 604/1226] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:41.633773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802abb64-131a-4579-9228-2bf107c11e1b None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:41.738267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802abb64-131a-4579-9228-2bf107c11e1b None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:41.771720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d1b19-ff0b-4bae-b4f6-e207d5b61460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:41.772397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d1b19-ff0b-4bae-b4f6-e207d5b61460 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:41.772688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d1b19-ff0b-4bae-b4f6-e207d5b61460 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:41.772944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d1b19-ff0b-4bae-b4f6-e207d5b61460 None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:41.773767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d1b19-ff0b-4bae-b4f6-e207d5b61460 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:41.774075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d1b19-ff0b-4bae-b4f6-e207d5b61460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:41.775518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d1b19-ff0b-4bae-b4f6-e207d5b61460 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:41.793374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 623/1227] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 00:15:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:41.799357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8b60c-a3ec-46cc-97e4-2da9519a33e7 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:41.895471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8b60c-a3ec-46cc-97e4-2da9519a33e7 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:41.929162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db5922-35c8-4ece-ac41-929199b677d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:41.929957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db5922-35c8-4ece-ac41-929199b677d9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:41.930233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db5922-35c8-4ece-ac41-929199b677d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:41.930533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db5922-35c8-4ece-ac41-929199b677d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:41.941958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db5922-35c8-4ece-ac41-929199b677d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:41.943443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db5922-35c8-4ece-ac41-929199b677d9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:41.961048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-a5db5922-35c8-4ece-ac41-929199b677d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:41.962561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 605/1228] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:41.968648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d1b19-ff0b-4bae-b4f6-e207d5b61460 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:42.073755 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d1b19-ff0b-4bae-b4f6-e207d5b61460 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:42.108403 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4570dd5-9314-4d27-b514-bd5adaec4d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:42.109238 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4570dd5-9314-4d27-b514-bd5adaec4d47 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:42.109618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4570dd5-9314-4d27-b514-bd5adaec4d47 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:42.109998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4570dd5-9314-4d27-b514-bd5adaec4d47 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:42.110737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4570dd5-9314-4d27-b514-bd5adaec4d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:42.111080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4570dd5-9314-4d27-b514-bd5adaec4d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:42.112389 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4570dd5-9314-4d27-b514-bd5adaec4d47 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:42.123368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 624/1229] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:42.129736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db5922-35c8-4ece-ac41-929199b677d9 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:42.235149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db5922-35c8-4ece-ac41-929199b677d9 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:42.277293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb22e99-504b-4abe-9eee-6692cd4a7705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:42.278074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb22e99-504b-4abe-9eee-6692cd4a7705 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:42.278397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb22e99-504b-4abe-9eee-6692cd4a7705 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:42.278668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb22e99-504b-4abe-9eee-6692cd4a7705 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:42.286990 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb22e99-504b-4abe-9eee-6692cd4a7705 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:42.288615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb22e99-504b-4abe-9eee-6692cd4a7705 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:42.303500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-aeb22e99-504b-4abe-9eee-6692cd4a7705 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:15:42.304834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 606/1230] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:42.312243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4570dd5-9314-4d27-b514-bd5adaec4d47 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:42.429669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4570dd5-9314-4d27-b514-bd5adaec4d47 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:42.466405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4947-6484-4f47-a92e-ec87fd05f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:42.467175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4947-6484-4f47-a92e-ec87fd05f171 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:42.467535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4947-6484-4f47-a92e-ec87fd05f171 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:42.467865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4947-6484-4f47-a92e-ec87fd05f171 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:42.468739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4947-6484-4f47-a92e-ec87fd05f171 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:42.469100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4947-6484-4f47-a92e-ec87fd05f171 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:42.470551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4947-6484-4f47-a92e-ec87fd05f171 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:42.609736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 625/1231] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:42.616509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb22e99-504b-4abe-9eee-6692cd4a7705 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:42.719458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb22e99-504b-4abe-9eee-6692cd4a7705 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:42.753296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d93ec-3183-48db-88b8-66053b9de075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:42.754186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d93ec-3183-48db-88b8-66053b9de075 None admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:42.754502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d93ec-3183-48db-88b8-66053b9de075 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:42.754781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d93ec-3183-48db-88b8-66053b9de075 None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/92588782f32a472193340aba2bff8d78/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:42.770604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d93ec-3183-48db-88b8-66053b9de075 None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=92588782f32a472193340aba2bff8d78, role_id=8ec0a126e9a54afab4f7ee9cd6bbc6c4)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:42.772071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d93ec-3183-48db-88b8-66053b9de075 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:42.787933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 607/1232] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:15:42 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/92588782f32a472193340aba2bff8d78/roles/8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:15:45.426024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9829-baa9-4b94-80d9-e968adc4cc84 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:45.426638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9829-baa9-4b94-80d9-e968adc4cc84 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:45.426638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9829-baa9-4b94-80d9-e968adc4cc84 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:45.427946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 626/1233] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:15:45.433563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dce59c-403b-4d55-a923-797f608f4f2e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:45.434016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dce59c-403b-4d55-a923-797f608f4f2e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:45.434123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dce59c-403b-4d55-a923-797f608f4f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:45.451262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-98dce59c-403b-4d55-a923-797f608f4f2e None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:15:45.452425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-98dce59c-403b-4d55-a923-797f608f4f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:45.522955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 608/1234] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:15:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 12 00:15:45.548347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa9829-baa9-4b94-80d9-e968adc4cc84 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:45.652024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa9829-baa9-4b94-80d9-e968adc4cc84 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:45.689750 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9b2a-a7a2-47cf-91be-84a122c3d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:45.690645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9b2a-a7a2-47cf-91be-84a122c3d4df None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:45.690940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9b2a-a7a2-47cf-91be-84a122c3d4df None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:45.691283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9b2a-a7a2-47cf-91be-84a122c3d4df None admin] PATH_INFO: `/v3/roles/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:45.702363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9b2a-a7a2-47cf-91be-84a122c3d4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:15:45.709827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2d5a9b2a-a7a2-47cf-91be-84a122c3d4df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 12 00:15:45.711665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 627/1235] 10.222.0.32 () {56 vars in 1102 bytes} [Tue Apr 12 00:15:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:45.718044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dce59c-403b-4d55-a923-797f608f4f2e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:45.822138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dce59c-403b-4d55-a923-797f608f4f2e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:45.855432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a9f2f-31ff-4036-9029-a015fb790b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:45.856240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a9f2f-31ff-4036-9029-a015fb790b1b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:45.856515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a9f2f-31ff-4036-9029-a015fb790b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:45.856850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a9f2f-31ff-4036-9029-a015fb790b1b None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:45.857707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a9f2f-31ff-4036-9029-a015fb790b1b None admin] RBAC: Adding query filter params (name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:45.858009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a9f2f-31ff-4036-9029-a015fb790b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:45.859818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a9f2f-31ff-4036-9029-a015fb790b1b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:45.869334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 609/1236] 10.222.0.32 () {56 vars in 1103 bytes} [Tue Apr 12 00:15:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:45.875049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9b2a-a7a2-47cf-91be-84a122c3d4df None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:45.981418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9b2a-a7a2-47cf-91be-84a122c3d4df None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:46.014260 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623a2c-3a3d-4f4f-8229-bd5a26be6254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:46.015047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623a2c-3a3d-4f4f-8229-bd5a26be6254 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:46.015325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623a2c-3a3d-4f4f-8229-bd5a26be6254 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:46.015595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92623a2c-3a3d-4f4f-8229-bd5a26be6254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:46.026097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92623a2c-3a3d-4f4f-8229-bd5a26be6254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:46.027582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92623a2c-3a3d-4f4f-8229-bd5a26be6254 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:46.049614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-92623a2c-3a3d-4f4f-8229-bd5a26be6254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:46.050841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 628/1237] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:15:46.056780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a9f2f-31ff-4036-9029-a015fb790b1b None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:46.161810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a9f2f-31ff-4036-9029-a015fb790b1b None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:46.195771 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cb098-b115-4da1-bc4a-26d08ff2b927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:46.196439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb098-b115-4da1-bc4a-26d08ff2b927 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:46.196893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb098-b115-4da1-bc4a-26d08ff2b927 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:46.197241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cb098-b115-4da1-bc4a-26d08ff2b927 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:46.198065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cb098-b115-4da1-bc4a-26d08ff2b927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:46.198475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cb098-b115-4da1-bc4a-26d08ff2b927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:46.199899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cb098-b115-4da1-bc4a-26d08ff2b927 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:46.212146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 610/1238] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:15:46.217655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623a2c-3a3d-4f4f-8229-bd5a26be6254 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:46.328198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92623a2c-3a3d-4f4f-8229-bd5a26be6254 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:46.364799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde737a1-0e59-4ea5-91a4-49a0072edb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:46.365705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde737a1-0e59-4ea5-91a4-49a0072edb2e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:46.366025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde737a1-0e59-4ea5-91a4-49a0072edb2e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:46.366386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde737a1-0e59-4ea5-91a4-49a0072edb2e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:46.374705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde737a1-0e59-4ea5-91a4-49a0072edb2e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:46.376133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde737a1-0e59-4ea5-91a4-49a0072edb2e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:46.391235 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-bde737a1-0e59-4ea5-91a4-49a0072edb2e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 00:15:46.392409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 629/1239] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:46.398905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cb098-b115-4da1-bc4a-26d08ff2b927 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:46.501473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cb098-b115-4da1-bc4a-26d08ff2b927 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:46.539400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6081f0-a446-4599-8bdb-b49067c7e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:46.540207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6081f0-a446-4599-8bdb-b49067c7e402 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:46.540545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6081f0-a446-4599-8bdb-b49067c7e402 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:46.540930 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6081f0-a446-4599-8bdb-b49067c7e402 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:46.541915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6081f0-a446-4599-8bdb-b49067c7e402 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:46.542302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6081f0-a446-4599-8bdb-b49067c7e402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:46.543937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6081f0-a446-4599-8bdb-b49067c7e402 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:46.561322 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 611/1240] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 00:15:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:46.567817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde737a1-0e59-4ea5-91a4-49a0072edb2e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:46.675372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde737a1-0e59-4ea5-91a4-49a0072edb2e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:46.711543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5def6-a0c2-41ab-bc46-d413414fd227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:46.712189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5def6-a0c2-41ab-bc46-d413414fd227 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:46.712474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5def6-a0c2-41ab-bc46-d413414fd227 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:46.712746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5def6-a0c2-41ab-bc46-d413414fd227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:46.782180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5def6-a0c2-41ab-bc46-d413414fd227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:46.783874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5def6-a0c2-41ab-bc46-d413414fd227 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:46.885688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 630/1241] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:15:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:15:46.891679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6081f0-a446-4599-8bdb-b49067c7e402 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:46.993987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6081f0-a446-4599-8bdb-b49067c7e402 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:47.030313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418366c9-824f-4d0f-bdfb-b0749eb794df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:47.031112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418366c9-824f-4d0f-bdfb-b0749eb794df None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:47.031463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418366c9-824f-4d0f-bdfb-b0749eb794df None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:47.031752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418366c9-824f-4d0f-bdfb-b0749eb794df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:47.041966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418366c9-824f-4d0f-bdfb-b0749eb794df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:47.043436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418366c9-824f-4d0f-bdfb-b0749eb794df None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:47.062463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-418366c9-824f-4d0f-bdfb-b0749eb794df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:47.063691 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 612/1242] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:47.070845 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5def6-a0c2-41ab-bc46-d413414fd227 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:47.174274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5def6-a0c2-41ab-bc46-d413414fd227 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:47.209691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5eb86-69fa-4ff2-a598-32763b1f9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:47.210451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5eb86-69fa-4ff2-a598-32763b1f9da3 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:47.210731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5eb86-69fa-4ff2-a598-32763b1f9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:47.211002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5eb86-69fa-4ff2-a598-32763b1f9da3 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:47.211713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5eb86-69fa-4ff2-a598-32763b1f9da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:47.212010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5eb86-69fa-4ff2-a598-32763b1f9da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:47.213353 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5eb86-69fa-4ff2-a598-32763b1f9da3 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:47.224236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 631/1243] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:47.230008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418366c9-824f-4d0f-bdfb-b0749eb794df None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:47.344177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418366c9-824f-4d0f-bdfb-b0749eb794df None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:47.392359 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc576ad-5e26-4f79-890b-761c849daa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:47.393313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc576ad-5e26-4f79-890b-761c849daa27 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:47.393669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc576ad-5e26-4f79-890b-761c849daa27 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:47.393998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc576ad-5e26-4f79-890b-761c849daa27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:47.402372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc576ad-5e26-4f79-890b-761c849daa27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:47.404138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc576ad-5e26-4f79-890b-761c849daa27 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:47.419588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-0dc576ad-5e26-4f79-890b-761c849daa27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:15:47.420902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 613/1244] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:15:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:47.427140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5eb86-69fa-4ff2-a598-32763b1f9da3 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:47.540596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5eb86-69fa-4ff2-a598-32763b1f9da3 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:47.575571 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4464a-a3e5-4e28-b844-1f998dd4a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:47.576397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4464a-a3e5-4e28-b844-1f998dd4a416 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:47.576719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4464a-a3e5-4e28-b844-1f998dd4a416 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:47.577058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4464a-a3e5-4e28-b844-1f998dd4a416 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:47.577925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4464a-a3e5-4e28-b844-1f998dd4a416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:47.578326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4464a-a3e5-4e28-b844-1f998dd4a416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:47.579930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4464a-a3e5-4e28-b844-1f998dd4a416 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:47.592377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 632/1245] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:15:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:47.599548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc576ad-5e26-4f79-890b-761c849daa27 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:47.708569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc576ad-5e26-4f79-890b-761c849daa27 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:47.746748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b44171-a671-48e0-b8a1-0015140a116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:47.747404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44171-a671-48e0-b8a1-0015140a116d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:47.747694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44171-a671-48e0-b8a1-0015140a116d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:47.747971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b44171-a671-48e0-b8a1-0015140a116d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:47.748789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44171-a671-48e0-b8a1-0015140a116d None admin] RBAC: Adding query filter params (role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=92588782f32a472193340aba2bff8d78) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:47.749097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44171-a671-48e0-b8a1-0015140a116d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:47.750560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b44171-a671-48e0-b8a1-0015140a116d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:47.757106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 614/1246] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:15:47 2022] GET /identity/v3/role_assignments?user.id=92588782f32a472193340aba2bff8d78&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=8ec0a126e9a54afab4f7ee9cd6bbc6c4 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:15:50.304613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac25b-ec65-4a3e-9960-0b977572c009 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:50.305164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac25b-ec65-4a3e-9960-0b977572c009 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:50.305164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bac25b-ec65-4a3e-9960-0b977572c009 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:50.306577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 633/1247] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:15:50.312463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1043b-9fca-4138-95ce-e66a115cfe5d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:50.312979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1043b-9fca-4138-95ce-e66a115cfe5d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:50.313068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1043b-9fca-4138-95ce-e66a115cfe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:50.331665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a7f1043b-9fca-4138-95ce-e66a115cfe5d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:15:50.333150 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a7f1043b-9fca-4138-95ce-e66a115cfe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:50.429730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 615/1248] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:15:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:15:50.455360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac25b-ec65-4a3e-9960-0b977572c009 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:50.553731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bac25b-ec65-4a3e-9960-0b977572c009 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:50.586667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ef1d-b0d0-4274-9544-44b0a845e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:50.587393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ef1d-b0d0-4274-9544-44b0a845e54e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:50.587677 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ef1d-b0d0-4274-9544-44b0a845e54e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:50.587953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ef1d-b0d0-4274-9544-44b0a845e54e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:50.597689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822ef1d-b0d0-4274-9544-44b0a845e54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:15:50.604537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-c822ef1d-b0d0-4274-9544-44b0a845e54e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:15:50.605723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 634/1249] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:15:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:50.611675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1043b-9fca-4138-95ce-e66a115cfe5d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:50.709496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1043b-9fca-4138-95ce-e66a115cfe5d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:50.742732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c1562-9003-4c12-add3-aa29c70b1cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:50.743394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c1562-9003-4c12-add3-aa29c70b1cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:50.743675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c1562-9003-4c12-add3-aa29c70b1cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:50.743947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c1562-9003-4c12-add3-aa29c70b1cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:50.744683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c1562-9003-4c12-add3-aa29c70b1cd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:50.744983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c1562-9003-4c12-add3-aa29c70b1cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:50.746374 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c1562-9003-4c12-add3-aa29c70b1cd8 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:50.754553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 616/1250] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:15:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:50.760220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ef1d-b0d0-4274-9544-44b0a845e54e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:50.853370 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ef1d-b0d0-4274-9544-44b0a845e54e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:50.883935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1fc4a-7d91-4a10-b8aa-ff7944908505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:50.884699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1fc4a-7d91-4a10-b8aa-ff7944908505 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:50.884980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1fc4a-7d91-4a10-b8aa-ff7944908505 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:50.885252 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1fc4a-7d91-4a10-b8aa-ff7944908505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:50.895035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1fc4a-7d91-4a10-b8aa-ff7944908505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:50.896437 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1fc4a-7d91-4a10-b8aa-ff7944908505 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:50.912615 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-82b1fc4a-7d91-4a10-b8aa-ff7944908505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:50.913746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 635/1251] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:50.919485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c1562-9003-4c12-add3-aa29c70b1cd8 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:51.011531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c1562-9003-4c12-add3-aa29c70b1cd8 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:51.043037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc224cb1-74a5-4709-8ccc-f668b5d40aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:51.043674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc224cb1-74a5-4709-8ccc-f668b5d40aef None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:51.043951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc224cb1-74a5-4709-8ccc-f668b5d40aef None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:51.044222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc224cb1-74a5-4709-8ccc-f668b5d40aef None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:51.044922 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc224cb1-74a5-4709-8ccc-f668b5d40aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:51.045222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc224cb1-74a5-4709-8ccc-f668b5d40aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:51.046596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc224cb1-74a5-4709-8ccc-f668b5d40aef None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:51.058020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 617/1252] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:51.063667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1fc4a-7d91-4a10-b8aa-ff7944908505 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:51.156632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1fc4a-7d91-4a10-b8aa-ff7944908505 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:51.188528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242cba-af06-4342-a259-e28feda0d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:51.189314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242cba-af06-4342-a259-e28feda0d8c5 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:51.189592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242cba-af06-4342-a259-e28feda0d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:51.189859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b242cba-af06-4342-a259-e28feda0d8c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:51.197140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b242cba-af06-4342-a259-e28feda0d8c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:51.198564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b242cba-af06-4342-a259-e28feda0d8c5 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:51.211358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2b242cba-af06-4342-a259-e28feda0d8c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 00:15:51.212510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 636/1253] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:51.218302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc224cb1-74a5-4709-8ccc-f668b5d40aef None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:51.310525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc224cb1-74a5-4709-8ccc-f668b5d40aef None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:51.343757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22490d73-31df-406c-bb6c-c6dbc8b33865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:51.344450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22490d73-31df-406c-bb6c-c6dbc8b33865 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:51.344689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22490d73-31df-406c-bb6c-c6dbc8b33865 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:51.344961 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22490d73-31df-406c-bb6c-c6dbc8b33865 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:51.345774 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22490d73-31df-406c-bb6c-c6dbc8b33865 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:51.346081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22490d73-31df-406c-bb6c-c6dbc8b33865 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:51.348202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22490d73-31df-406c-bb6c-c6dbc8b33865 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:51.366090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 618/1254] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 00:15:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:51.372839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242cba-af06-4342-a259-e28feda0d8c5 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:51.465448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b242cba-af06-4342-a259-e28feda0d8c5 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:51.496335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd32134-7d4b-41d0-856d-f2d2cf3a4cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:51.496965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd32134-7d4b-41d0-856d-f2d2cf3a4cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:51.497250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd32134-7d4b-41d0-856d-f2d2cf3a4cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:51.497525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd32134-7d4b-41d0-856d-f2d2cf3a4cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:51.559447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd32134-7d4b-41d0-856d-f2d2cf3a4cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:51.560871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd32134-7d4b-41d0-856d-f2d2cf3a4cf3 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:51.651036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 637/1255] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:15:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 12 00:15:51.656675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22490d73-31df-406c-bb6c-c6dbc8b33865 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:51.750723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22490d73-31df-406c-bb6c-c6dbc8b33865 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:51.781648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582defd8-a601-4647-a768-bff227fe2510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:51.782458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582defd8-a601-4647-a768-bff227fe2510 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:51.782745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582defd8-a601-4647-a768-bff227fe2510 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:51.783023 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582defd8-a601-4647-a768-bff227fe2510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:51.793129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582defd8-a601-4647-a768-bff227fe2510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:51.794599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582defd8-a601-4647-a768-bff227fe2510 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:51.811077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-582defd8-a601-4647-a768-bff227fe2510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:51.812467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 619/1256] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:51.818030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd32134-7d4b-41d0-856d-f2d2cf3a4cf3 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:51.908267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd32134-7d4b-41d0-856d-f2d2cf3a4cf3 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:51.940246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8621f41-6ea4-4df6-b3f4-fb60c49ee2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:51.940913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8621f41-6ea4-4df6-b3f4-fb60c49ee2c9 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:51.941196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8621f41-6ea4-4df6-b3f4-fb60c49ee2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:51.941468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8621f41-6ea4-4df6-b3f4-fb60c49ee2c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:51.942166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8621f41-6ea4-4df6-b3f4-fb60c49ee2c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:51.942496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8621f41-6ea4-4df6-b3f4-fb60c49ee2c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:51.943831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8621f41-6ea4-4df6-b3f4-fb60c49ee2c9 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:51.954167 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 638/1257] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:51.959420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582defd8-a601-4647-a768-bff227fe2510 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:52.053006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582defd8-a601-4647-a768-bff227fe2510 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:52.085180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290a42-9ae6-47c0-801c-bac2e6a72797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:52.085948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290a42-9ae6-47c0-801c-bac2e6a72797 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:52.086229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290a42-9ae6-47c0-801c-bac2e6a72797 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:52.086530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce290a42-9ae6-47c0-801c-bac2e6a72797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:52.092760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce290a42-9ae6-47c0-801c-bac2e6a72797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:52.094175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce290a42-9ae6-47c0-801c-bac2e6a72797 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:52.107113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-ce290a42-9ae6-47c0-801c-bac2e6a72797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:15:52.108241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 620/1258] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:15:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:52.113882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8621f41-6ea4-4df6-b3f4-fb60c49ee2c9 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:52.205250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8621f41-6ea4-4df6-b3f4-fb60c49ee2c9 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:52.236493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8561d-bbc9-416c-8390-12f2df4e48b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:52.237135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8561d-bbc9-416c-8390-12f2df4e48b0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:52.237416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8561d-bbc9-416c-8390-12f2df4e48b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:52.237725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8561d-bbc9-416c-8390-12f2df4e48b0 None admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:52.238518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8561d-bbc9-416c-8390-12f2df4e48b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:52.238823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8561d-bbc9-416c-8390-12f2df4e48b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:52.240220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8561d-bbc9-416c-8390-12f2df4e48b0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:52.251307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 639/1259] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:15:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:52.257110 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290a42-9ae6-47c0-801c-bac2e6a72797 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:52.359064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce290a42-9ae6-47c0-801c-bac2e6a72797 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:52.395454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c5a5-201f-4e7e-ae16-750254f00e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:52.396100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c5a5-201f-4e7e-ae16-750254f00e6b None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:52.396384 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c5a5-201f-4e7e-ae16-750254f00e6b None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:52.396659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c5a5-201f-4e7e-ae16-750254f00e6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:52.397483 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9c5a5-201f-4e7e-ae16-750254f00e6b None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=92588782f32a472193340aba2bff8d78) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:52.397791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9c5a5-201f-4e7e-ae16-750254f00e6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:52.399235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9c5a5-201f-4e7e-ae16-750254f00e6b None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:52.404409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 621/1260] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:15:52 2022] GET /identity/v3/role_assignments?user.id=92588782f32a472193340aba2bff8d78&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=f0208c43117c4b799194c83781a46e09 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:54.651625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97b98-a71c-41fa-b3e5-e3d2599380e0 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:54.652157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97b98-a71c-41fa-b3e5-e3d2599380e0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:54.652157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97b98-a71c-41fa-b3e5-e3d2599380e0 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:54.653500 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 640/1261] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:15:54.658642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65243d5b-378e-4c8e-a32d-15cabf1c972b None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:54.659048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65243d5b-378e-4c8e-a32d-15cabf1c972b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:54.659484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65243d5b-378e-4c8e-a32d-15cabf1c972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:54.675735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-65243d5b-378e-4c8e-a32d-15cabf1c972b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:15:54.676909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-65243d5b-378e-4c8e-a32d-15cabf1c972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:54.738778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 622/1262] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:15:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:15:54.761418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa97b98-a71c-41fa-b3e5-e3d2599380e0 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:54.853428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa97b98-a71c-41fa-b3e5-e3d2599380e0 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:54.884178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259e135-9934-4d30-bcfd-dbf04801f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:54.884943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e135-9934-4d30-bcfd-dbf04801f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:54.885221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e135-9934-4d30-bcfd-dbf04801f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:54.885489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259e135-9934-4d30-bcfd-dbf04801f0b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:54.894905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259e135-9934-4d30-bcfd-dbf04801f0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:15:54.901575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-2259e135-9934-4d30-bcfd-dbf04801f0b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:15:54.902790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 641/1263] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:54.910570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65243d5b-378e-4c8e-a32d-15cabf1c972b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:55.001104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65243d5b-378e-4c8e-a32d-15cabf1c972b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:55.032534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538eaf5-c6a6-4ec9-b311-81f18ea66e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:55.033184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538eaf5-c6a6-4ec9-b311-81f18ea66e0d None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:55.033467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538eaf5-c6a6-4ec9-b311-81f18ea66e0d None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:55.033742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538eaf5-c6a6-4ec9-b311-81f18ea66e0d None admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:55.035316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538eaf5-c6a6-4ec9-b311-81f18ea66e0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:55.035620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538eaf5-c6a6-4ec9-b311-81f18ea66e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:55.036977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538eaf5-c6a6-4ec9-b311-81f18ea66e0d None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:55.044542 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 623/1264] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:55.049981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259e135-9934-4d30-bcfd-dbf04801f0b9 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:55.140958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259e135-9934-4d30-bcfd-dbf04801f0b9 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:55.171506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3944a-1021-47df-a6c0-58c49f3a5b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:55.172215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3944a-1021-47df-a6c0-58c49f3a5b83 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:55.172492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3944a-1021-47df-a6c0-58c49f3a5b83 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:55.172759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3944a-1021-47df-a6c0-58c49f3a5b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:55.182980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3944a-1021-47df-a6c0-58c49f3a5b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:55.184384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3944a-1021-47df-a6c0-58c49f3a5b83 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:55.200224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-e2a3944a-1021-47df-a6c0-58c49f3a5b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:55.201340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 642/1265] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:55.207037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538eaf5-c6a6-4ec9-b311-81f18ea66e0d None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:55.299690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538eaf5-c6a6-4ec9-b311-81f18ea66e0d None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:55.332840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48750a0f-62d2-470b-a615-d127389df7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:55.333499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48750a0f-62d2-470b-a615-d127389df7c3 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:55.333654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48750a0f-62d2-470b-a615-d127389df7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:55.333937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48750a0f-62d2-470b-a615-d127389df7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:55.334669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48750a0f-62d2-470b-a615-d127389df7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:55.334969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48750a0f-62d2-470b-a615-d127389df7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:55.336315 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48750a0f-62d2-470b-a615-d127389df7c3 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:55.348440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 624/1266] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:55.353913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3944a-1021-47df-a6c0-58c49f3a5b83 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:55.454723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3944a-1021-47df-a6c0-58c49f3a5b83 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:55.485144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a2a1-dc73-4bb9-9685-a3b1da10cb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:55.485928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a2a1-dc73-4bb9-9685-a3b1da10cb7e None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:55.486209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a2a1-dc73-4bb9-9685-a3b1da10cb7e None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:55.486520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d3a2a1-dc73-4bb9-9685-a3b1da10cb7e None admin] PATH_INFO: `/v3/users/placement` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:55.493996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3a2a1-dc73-4bb9-9685-a3b1da10cb7e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:55.495441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d3a2a1-dc73-4bb9-9685-a3b1da10cb7e None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:55.508266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-20d3a2a1-dc73-4bb9-9685-a3b1da10cb7e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 00:15:55.509389 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 643/1267] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:15:55.515180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48750a0f-62d2-470b-a615-d127389df7c3 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:55.606639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48750a0f-62d2-470b-a615-d127389df7c3 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:55.639563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03137433-d98b-42bb-adf6-36cd486644f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:55.640213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03137433-d98b-42bb-adf6-36cd486644f9 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:55.640503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03137433-d98b-42bb-adf6-36cd486644f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:55.640777 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03137433-d98b-42bb-adf6-36cd486644f9 None admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:55.641594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03137433-d98b-42bb-adf6-36cd486644f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:55.641900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03137433-d98b-42bb-adf6-36cd486644f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:55.643334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03137433-d98b-42bb-adf6-36cd486644f9 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:55.660967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 625/1268] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 00:15:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:55.666473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a2a1-dc73-4bb9-9685-a3b1da10cb7e None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:55.758363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d3a2a1-dc73-4bb9-9685-a3b1da10cb7e None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:55.790182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc12ca-acba-4a35-a5e3-3dfb828015b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:55.790976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc12ca-acba-4a35-a5e3-3dfb828015b0 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:55.791257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc12ca-acba-4a35-a5e3-3dfb828015b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:55.791529 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc12ca-acba-4a35-a5e3-3dfb828015b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:55.801784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc12ca-acba-4a35-a5e3-3dfb828015b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:55.803230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc12ca-acba-4a35-a5e3-3dfb828015b0 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:55.819136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-05cc12ca-acba-4a35-a5e3-3dfb828015b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:55.820271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 644/1269] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:55.825821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03137433-d98b-42bb-adf6-36cd486644f9 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:55.917152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03137433-d98b-42bb-adf6-36cd486644f9 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:55.948553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872670b-8761-42c0-a64d-21bf7ba9f730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:55.949187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872670b-8761-42c0-a64d-21bf7ba9f730 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:55.949471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872670b-8761-42c0-a64d-21bf7ba9f730 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:55.949740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872670b-8761-42c0-a64d-21bf7ba9f730 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:55.950471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872670b-8761-42c0-a64d-21bf7ba9f730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:55.950765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872670b-8761-42c0-a64d-21bf7ba9f730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:55.952098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872670b-8761-42c0-a64d-21bf7ba9f730 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:55.962604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 626/1270] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:55.968057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc12ca-acba-4a35-a5e3-3dfb828015b0 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:56.059977 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc12ca-acba-4a35-a5e3-3dfb828015b0 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:56.090405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bd033-a8dc-4675-9462-b03ff5ac1304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:56.091168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bd033-a8dc-4675-9462-b03ff5ac1304 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:56.091447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bd033-a8dc-4675-9462-b03ff5ac1304 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:56.091719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bd033-a8dc-4675-9462-b03ff5ac1304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:56.098487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bd033-a8dc-4675-9462-b03ff5ac1304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:56.099891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bd033-a8dc-4675-9462-b03ff5ac1304 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:56.112613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-f34bd033-a8dc-4675-9462-b03ff5ac1304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:15:56.113716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 645/1271] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:15:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:56.119172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872670b-8761-42c0-a64d-21bf7ba9f730 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:56.211367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872670b-8761-42c0-a64d-21bf7ba9f730 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:56.242795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace37bde-5557-4a07-9851-817a0dae3f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:56.243429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace37bde-5557-4a07-9851-817a0dae3f61 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:56.243707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace37bde-5557-4a07-9851-817a0dae3f61 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:56.243976 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace37bde-5557-4a07-9851-817a0dae3f61 None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:56.244737 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace37bde-5557-4a07-9851-817a0dae3f61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:56.245035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace37bde-5557-4a07-9851-817a0dae3f61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:56.246442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace37bde-5557-4a07-9851-817a0dae3f61 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:56.257809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 627/1272] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:15:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:56.263349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bd033-a8dc-4675-9462-b03ff5ac1304 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:56.362334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bd033-a8dc-4675-9462-b03ff5ac1304 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:56.394694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dca899-1ae5-4440-a6b3-f08a9f15709b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:56.395572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dca899-1ae5-4440-a6b3-f08a9f15709b None admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:56.395853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dca899-1ae5-4440-a6b3-f08a9f15709b None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:56.396123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dca899-1ae5-4440-a6b3-f08a9f15709b None admin] PATH_INFO: `/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/92588782f32a472193340aba2bff8d78/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:56.398020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dca899-1ae5-4440-a6b3-f08a9f15709b None admin] RBAC: Authorizing `identity:create_grant(project_id=a3b37e79901c4d73b569b38bf7851db6, user_id=92588782f32a472193340aba2bff8d78, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:56.399473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dca899-1ae5-4440-a6b3-f08a9f15709b None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:56.411414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 646/1273] 10.222.0.32 () {58 vars in 1439 bytes} [Tue Apr 12 00:15:56 2022] PUT /identity/v3/projects/a3b37e79901c4d73b569b38bf7851db6/users/92588782f32a472193340aba2bff8d78/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:15:58.680634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e11314-7483-41fe-891c-695b95523f6e None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:58.681103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e11314-7483-41fe-891c-695b95523f6e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:58.681194 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e11314-7483-41fe-891c-695b95523f6e None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:58.682584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 628/1274] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:15:58.687717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb15da7-dc10-4426-bdaf-0ce9290e57c0 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:58.688145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb15da7-dc10-4426-bdaf-0ce9290e57c0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:58.688275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb15da7-dc10-4426-bdaf-0ce9290e57c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:58.704611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-fdb15da7-dc10-4426-bdaf-0ce9290e57c0 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:15:58.705764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fdb15da7-dc10-4426-bdaf-0ce9290e57c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:58.766695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 647/1275] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:15:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:15:58.791207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e11314-7483-41fe-891c-695b95523f6e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:58.884087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e11314-7483-41fe-891c-695b95523f6e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:58.915920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c5afb-5db4-4a94-886c-70189cb940d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:58.916739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c5afb-5db4-4a94-886c-70189cb940d2 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:58.916966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c5afb-5db4-4a94-886c-70189cb940d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:58.917239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c5afb-5db4-4a94-886c-70189cb940d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:58.926724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c5afb-5db4-4a94-886c-70189cb940d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 12 00:15:58.933485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-c38c5afb-5db4-4a94-886c-70189cb940d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 12 00:15:58.934667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 629/1276] 10.222.0.32 () {56 vars in 1096 bytes} [Tue Apr 12 00:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:58.940413 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb15da7-dc10-4426-bdaf-0ce9290e57c0 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:59.030231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb15da7-dc10-4426-bdaf-0ce9290e57c0 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:59.061936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a04da-6d0c-4877-80a8-3d6cc16d6c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:59.062611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a04da-6d0c-4877-80a8-3d6cc16d6c9d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:59.062891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a04da-6d0c-4877-80a8-3d6cc16d6c9d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:59.063163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a04da-6d0c-4877-80a8-3d6cc16d6c9d None admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:59.063893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a04da-6d0c-4877-80a8-3d6cc16d6c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:59.064196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a04da-6d0c-4877-80a8-3d6cc16d6c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:59.065542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a04da-6d0c-4877-80a8-3d6cc16d6c9d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:59.073018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 648/1277] 10.222.0.32 () {56 vars in 1099 bytes} [Tue Apr 12 00:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:59.078413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c5afb-5db4-4a94-886c-70189cb940d2 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:59.171755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c5afb-5db4-4a94-886c-70189cb940d2 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:59.202520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39931b92-3215-4787-9a64-c42bb645db28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:59.203284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39931b92-3215-4787-9a64-c42bb645db28 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:59.203560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39931b92-3215-4787-9a64-c42bb645db28 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:59.203828 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39931b92-3215-4787-9a64-c42bb645db28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:59.214139 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39931b92-3215-4787-9a64-c42bb645db28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:59.215584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39931b92-3215-4787-9a64-c42bb645db28 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:59.230926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-39931b92-3215-4787-9a64-c42bb645db28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:15:59.232065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 630/1278] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:15:59.237770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a04da-6d0c-4877-80a8-3d6cc16d6c9d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:59.333635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a04da-6d0c-4877-80a8-3d6cc16d6c9d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:59.367263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d883949-9e45-4bff-9cda-57da42d3981d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:59.367901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883949-9e45-4bff-9cda-57da42d3981d None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:59.368182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883949-9e45-4bff-9cda-57da42d3981d None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:59.368470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883949-9e45-4bff-9cda-57da42d3981d None admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:59.369166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d883949-9e45-4bff-9cda-57da42d3981d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:59.369468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d883949-9e45-4bff-9cda-57da42d3981d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:59.370860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d883949-9e45-4bff-9cda-57da42d3981d None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:59.383477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 649/1279] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:59.390352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39931b92-3215-4787-9a64-c42bb645db28 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:59.483789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39931b92-3215-4787-9a64-c42bb645db28 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:59.515109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730796a-dc81-4dd8-89cc-fcdaa9224576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:59.515883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730796a-dc81-4dd8-89cc-fcdaa9224576 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:59.516166 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730796a-dc81-4dd8-89cc-fcdaa9224576 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:59.516439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730796a-dc81-4dd8-89cc-fcdaa9224576 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:59.523433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730796a-dc81-4dd8-89cc-fcdaa9224576 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:59.524846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730796a-dc81-4dd8-89cc-fcdaa9224576 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:59.538008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-7730796a-dc81-4dd8-89cc-fcdaa9224576 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 12 00:15:59.539176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 631/1280] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:15:59.545036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d883949-9e45-4bff-9cda-57da42d3981d None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:59.637929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d883949-9e45-4bff-9cda-57da42d3981d None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:59.668678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8fe1-7579-4e1f-a413-88b9c0003bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:59.669337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8fe1-7579-4e1f-a413-88b9c0003bed None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:59.669613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8fe1-7579-4e1f-a413-88b9c0003bed None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:59.669881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8fe1-7579-4e1f-a413-88b9c0003bed None admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:59.670726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8fe1-7579-4e1f-a413-88b9c0003bed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:15:59.671027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8fe1-7579-4e1f-a413-88b9c0003bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:59.672427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8fe1-7579-4e1f-a413-88b9c0003bed None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:59.688939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 650/1281] 10.222.0.32 () {56 vars in 1143 bytes} [Tue Apr 12 00:15:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:15:59.695474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730796a-dc81-4dd8-89cc-fcdaa9224576 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:59.787844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730796a-dc81-4dd8-89cc-fcdaa9224576 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:59.818759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9af67b-b9c8-4a29-9997-a95ded910b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:59.819381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9af67b-b9c8-4a29-9997-a95ded910b38 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:59.819665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9af67b-b9c8-4a29-9997-a95ded910b38 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:59.819945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9af67b-b9c8-4a29-9997-a95ded910b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:59.881526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9af67b-b9c8-4a29-9997-a95ded910b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:59.882973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9af67b-b9c8-4a29-9997-a95ded910b38 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:59.973367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 632/1282] 10.222.0.32 () {58 vars in 1282 bytes} [Tue Apr 12 00:15:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 12 00:15:59.979067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8fe1-7579-4e1f-a413-88b9c0003bed None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:00.069491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8fe1-7579-4e1f-a413-88b9c0003bed None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:00.100262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4db00-2172-4e11-8f1a-b92400c12b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:00.101029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4db00-2172-4e11-8f1a-b92400c12b17 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:00.101304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4db00-2172-4e11-8f1a-b92400c12b17 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:00.101572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4db00-2172-4e11-8f1a-b92400c12b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:00.110853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4db00-2172-4e11-8f1a-b92400c12b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:00.112258 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4db00-2172-4e11-8f1a-b92400c12b17 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:00.127918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-56f4db00-2172-4e11-8f1a-b92400c12b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 12 00:16:00.129531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 651/1283] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:15:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:16:00.135089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9af67b-b9c8-4a29-9997-a95ded910b38 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:00.228145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9af67b-b9c8-4a29-9997-a95ded910b38 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:00.259121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4bf47-1a13-47c4-abef-7ed507a52a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:00.259765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4bf47-1a13-47c4-abef-7ed507a52a34 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:00.260050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4bf47-1a13-47c4-abef-7ed507a52a34 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:00.260327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4bf47-1a13-47c4-abef-7ed507a52a34 None admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:00.261032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4bf47-1a13-47c4-abef-7ed507a52a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:16:00.261338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4bf47-1a13-47c4-abef-7ed507a52a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:00.262726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4bf47-1a13-47c4-abef-7ed507a52a34 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:00.273828 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 633/1284] 10.222.0.32 () {56 vars in 1109 bytes} [Tue Apr 12 00:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:16:00.279139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4db00-2172-4e11-8f1a-b92400c12b17 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:00.373424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4db00-2172-4e11-8f1a-b92400c12b17 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:00.404708 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60dec0-650d-456f-8d0e-0b76131b65b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:00.405481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60dec0-650d-456f-8d0e-0b76131b65b9 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:00.405767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60dec0-650d-456f-8d0e-0b76131b65b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:00.406045 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60dec0-650d-456f-8d0e-0b76131b65b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:00.413166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60dec0-650d-456f-8d0e-0b76131b65b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:00.414607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60dec0-650d-456f-8d0e-0b76131b65b9 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:00.427177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING keystone.server.flask.application [None req-da60dec0-650d-456f-8d0e-0b76131b65b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 12 00:16:00.428313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 652/1285] 10.222.0.32 () {56 vars in 1111 bytes} [Tue Apr 12 00:16:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 12 00:16:00.433931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4bf47-1a13-47c4-abef-7ed507a52a34 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:00.526970 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4bf47-1a13-47c4-abef-7ed507a52a34 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:00.558712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f46d6-e937-4dcc-bad4-56a160bb424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:00.559353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f46d6-e937-4dcc-bad4-56a160bb424e None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:00.559639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f46d6-e937-4dcc-bad4-56a160bb424e None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:00.559922 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f46d6-e937-4dcc-bad4-56a160bb424e None admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:00.560691 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f46d6-e937-4dcc-bad4-56a160bb424e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:16:00.560999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f46d6-e937-4dcc-bad4-56a160bb424e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:00.562432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f46d6-e937-4dcc-bad4-56a160bb424e None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:00.573714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 634/1286] 10.222.0.32 () {56 vars in 1148 bytes} [Tue Apr 12 00:16:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:16:00.579404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60dec0-650d-456f-8d0e-0b76131b65b9 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:00.670911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60dec0-650d-456f-8d0e-0b76131b65b9 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:00.702049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1b17e-5fde-4882-a2c4-def56129eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:00.702757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b17e-5fde-4882-a2c4-def56129eae4 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:00.703042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b17e-5fde-4882-a2c4-def56129eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:00.703320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1b17e-5fde-4882-a2c4-def56129eae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:00.704139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1b17e-5fde-4882-a2c4-def56129eae4 None admin] RBAC: Adding query filter params (role.id=f0208c43117c4b799194c83781a46e09, scope.project.id=a3b37e79901c4d73b569b38bf7851db6, user.id=92588782f32a472193340aba2bff8d78) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:16:00.704452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1b17e-5fde-4882-a2c4-def56129eae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:00.705856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1b17e-5fde-4882-a2c4-def56129eae4 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:00.712031 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 653/1287] 10.222.0.32 () {56 vars in 1374 bytes} [Tue Apr 12 00:16:00 2022] GET /identity/v3/role_assignments?user.id=92588782f32a472193340aba2bff8d78&scope.project.id=a3b37e79901c4d73b569b38bf7851db6&role.id=f0208c43117c4b799194c83781a46e09 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:16:03.000756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407b0c-d9a2-4511-97a9-a6995f6b1b0e None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:03.001271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407b0c-d9a2-4511-97a9-a6995f6b1b0e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:03.001386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407b0c-d9a2-4511-97a9-a6995f6b1b0e None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:03.002725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 635/1288] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:16:03.008363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2d5c8-c9fb-4b33-b5f2-663c7cf2b21f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:03.008729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2d5c8-c9fb-4b33-b5f2-663c7cf2b21f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:03.008928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2d5c8-c9fb-4b33-b5f2-663c7cf2b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:03.026394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b6f2d5c8-c9fb-4b33-b5f2-663c7cf2b21f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:16:03.027563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b6f2d5c8-c9fb-4b33-b5f2-663c7cf2b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:16:03.089262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 654/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:16:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:16:03.110962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407b0c-d9a2-4511-97a9-a6995f6b1b0e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:03.207606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407b0c-d9a2-4511-97a9-a6995f6b1b0e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:03.239090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd4bb7-f013-41b8-b6d9-8cc5d440f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:03.239870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd4bb7-f013-41b8-b6d9-8cc5d440f598 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:03.240156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd4bb7-f013-41b8-b6d9-8cc5d440f598 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:03.240432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd4bb7-f013-41b8-b6d9-8cc5d440f598 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:03.241083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd4bb7-f013-41b8-b6d9-8cc5d440f598 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:03.242462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebd4bb7-f013-41b8-b6d9-8cc5d440f598 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:03.253707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-eebd4bb7-f013-41b8-b6d9-8cc5d440f598 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 00:16:03.254825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 636/1290] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:16:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:16:03.262058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2d5c8-c9fb-4b33-b5f2-663c7cf2b21f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:03.360090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2d5c8-c9fb-4b33-b5f2-663c7cf2b21f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:03.399340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16290423-679e-4c6c-b61f-cadf96fea857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:03.400071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16290423-679e-4c6c-b61f-cadf96fea857 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:03.400430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16290423-679e-4c6c-b61f-cadf96fea857 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:03.400781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16290423-679e-4c6c-b61f-cadf96fea857 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:03.401682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16290423-679e-4c6c-b61f-cadf96fea857 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:16:03.402063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16290423-679e-4c6c-b61f-cadf96fea857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:03.403668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16290423-679e-4c6c-b61f-cadf96fea857 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:03.409373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 655/1291] 10.222.0.32 () {56 vars in 1116 bytes} [Tue Apr 12 00:16:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:16:03.415114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd4bb7-f013-41b8-b6d9-8cc5d440f598 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:03.508290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebd4bb7-f013-41b8-b6d9-8cc5d440f598 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:03.539077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05b64c-8f7b-4151-83d8-ef90b7f51ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:03.539717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05b64c-8f7b-4151-83d8-ef90b7f51ea4 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:03.540002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05b64c-8f7b-4151-83d8-ef90b7f51ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:03.540280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05b64c-8f7b-4151-83d8-ef90b7f51ea4 None admin] PATH_INFO: `/v3/services` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:03.540967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05b64c-8f7b-4151-83d8-ef90b7f51ea4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:16:03.541272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05b64c-8f7b-4151-83d8-ef90b7f51ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:03.542652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05b64c-8f7b-4151-83d8-ef90b7f51ea4 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:03.546828 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 637/1292] 10.222.0.32 () {56 vars in 1116 bytes} [Tue Apr 12 00:16:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:16:05.806064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35219-6be2-4b15-9555-8e162c01b611 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:05.806651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35219-6be2-4b15-9555-8e162c01b611 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:05.806651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35219-6be2-4b15-9555-8e162c01b611 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:05.807968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 656/1293] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:16:05.813118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f6b57-9930-41b9-9d0b-c2fc223d6631 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:05.813507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f6b57-9930-41b9-9d0b-c2fc223d6631 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:05.813685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f6b57-9930-41b9-9d0b-c2fc223d6631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:05.830719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-387f6b57-9930-41b9-9d0b-c2fc223d6631 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:16:05.831926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-387f6b57-9930-41b9-9d0b-c2fc223d6631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:16:05.894130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 638/1294] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:16:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:16:05.917797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35219-6be2-4b15-9555-8e162c01b611 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:06.011714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35219-6be2-4b15-9555-8e162c01b611 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:06.043162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca8a3f-9490-4655-8873-41580cc4addb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:06.043814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca8a3f-9490-4655-8873-41580cc4addb None admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:06.044098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca8a3f-9490-4655-8873-41580cc4addb None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:06.044375 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca8a3f-9490-4655-8873-41580cc4addb None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:06.045076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca8a3f-9490-4655-8873-41580cc4addb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:06.046451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca8a3f-9490-4655-8873-41580cc4addb None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:06.059567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 657/1295] 10.222.0.32 () {60 vars in 1141 bytes} [Tue Apr 12 00:16:05 2022] POST /identity/v3/services => generated 246 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:16:08.348262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8063ca1-ae49-49a3-9aa2-ace29c93aefc None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:08.348903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8063ca1-ae49-49a3-9aa2-ace29c93aefc None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:08.349011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8063ca1-ae49-49a3-9aa2-ace29c93aefc None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:08.350742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 639/1296] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:16:08.356021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21cf8-a414-4960-8b1b-59657c01b720 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:08.356680 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21cf8-a414-4960-8b1b-59657c01b720 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:08.356680 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a21cf8-a414-4960-8b1b-59657c01b720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:08.373611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-15a21cf8-a414-4960-8b1b-59657c01b720 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:16:08.374920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-15a21cf8-a414-4960-8b1b-59657c01b720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:16:08.444671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 658/1297] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:16:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:16:08.469068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8063ca1-ae49-49a3-9aa2-ace29c93aefc None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:08.563927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8063ca1-ae49-49a3-9aa2-ace29c93aefc None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:08.595492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffcbb0-af92-45f9-b140-c6a959a04fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:08.596265 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffcbb0-af92-45f9-b140-c6a959a04fad None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:08.596577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffcbb0-af92-45f9-b140-c6a959a04fad None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:08.596850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffcbb0-af92-45f9-b140-c6a959a04fad None admin] PATH_INFO: `/v3/services/placement` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:08.597488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffcbb0-af92-45f9-b140-c6a959a04fad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:08.598919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ffcbb0-af92-45f9-b140-c6a959a04fad None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:08.609469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-b5ffcbb0-af92-45f9-b140-c6a959a04fad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 00:16:08.610628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 640/1298] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:16:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:16:08.616889 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21cf8-a414-4960-8b1b-59657c01b720 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:08.707541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a21cf8-a414-4960-8b1b-59657c01b720 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:08.738385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a97c4-4c3d-4362-bd75-1f62949b4ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:08.739030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a97c4-4c3d-4362-bd75-1f62949b4ef1 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:08.739310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a97c4-4c3d-4362-bd75-1f62949b4ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:08.739583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a97c4-4c3d-4362-bd75-1f62949b4ef1 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:08.740277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a97c4-4c3d-4362-bd75-1f62949b4ef1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:16:08.740577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a97c4-4c3d-4362-bd75-1f62949b4ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:08.741917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656a97c4-4c3d-4362-bd75-1f62949b4ef1 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:08.746724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 659/1299] 10.222.0.32 () {56 vars in 1116 bytes} [Tue Apr 12 00:16:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:16:08.752505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffcbb0-af92-45f9-b140-c6a959a04fad None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:08.844753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ffcbb0-af92-45f9-b140-c6a959a04fad None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:08.875590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456bf99-0ddc-4e7a-93d1-29025dbf1159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:08.876165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456bf99-0ddc-4e7a-93d1-29025dbf1159 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:08.876447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456bf99-0ddc-4e7a-93d1-29025dbf1159 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:08.876723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456bf99-0ddc-4e7a-93d1-29025dbf1159 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:08.877493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456bf99-0ddc-4e7a-93d1-29025dbf1159 None admin] RBAC: Adding query filter params (interface=public, service_id=ead28c0ba9e04bafa29342d21387f055, region_id=RegionOne) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:16:08.878348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456bf99-0ddc-4e7a-93d1-29025dbf1159 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:08.879718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456bf99-0ddc-4e7a-93d1-29025dbf1159 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:08.884395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 641/1300] 10.222.0.32 () {56 vars in 1251 bytes} [Tue Apr 12 00:16:08 2022] GET /identity/v3/endpoints?service_id=ead28c0ba9e04bafa29342d21387f055&interface=public®ion_id=RegionOne => generated 194 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:16:08.889649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a97c4-4c3d-4362-bd75-1f62949b4ef1 None admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:08.980638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656a97c4-4c3d-4362-bd75-1f62949b4ef1 None admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:09.012090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44298b81-b9bb-401a-ae8a-6051d748ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:09.012738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298b81-b9bb-401a-ae8a-6051d748ff73 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:09.013022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298b81-b9bb-401a-ae8a-6051d748ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:09.013298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44298b81-b9bb-401a-ae8a-6051d748ff73 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:09.013966 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44298b81-b9bb-401a-ae8a-6051d748ff73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:09.015342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44298b81-b9bb-401a-ae8a-6051d748ff73 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:09.021701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 660/1301] 10.222.0.32 () {56 vars in 1087 bytes} [Tue Apr 12 00:16:08 2022] GET /identity/v3/services => generated 2191 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:16:11.294350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c29d8c-d737-41e0-ba47-57f4a8df2c60 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:11.294906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c29d8c-d737-41e0-ba47-57f4a8df2c60 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:11.294906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c29d8c-d737-41e0-ba47-57f4a8df2c60 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:11.296275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 642/1302] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:16:11.301758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4772ecb-9884-45da-a90f-aa43361d6899 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:11.302226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4772ecb-9884-45da-a90f-aa43361d6899 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:11.302349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4772ecb-9884-45da-a90f-aa43361d6899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:11.319537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b4772ecb-9884-45da-a90f-aa43361d6899 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:16:11.320706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b4772ecb-9884-45da-a90f-aa43361d6899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:16:11.385050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 661/1303] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:16:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 12 00:16:11.409814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c29d8c-d737-41e0-ba47-57f4a8df2c60 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:11.503993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c29d8c-d737-41e0-ba47-57f4a8df2c60 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:11.535406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267f48f-3462-4f76-9b8b-6fc438d40b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:11.536170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267f48f-3462-4f76-9b8b-6fc438d40b82 None admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:11.536447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267f48f-3462-4f76-9b8b-6fc438d40b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:11.536715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267f48f-3462-4f76-9b8b-6fc438d40b82 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:11.537341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267f48f-3462-4f76-9b8b-6fc438d40b82 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:11.538715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267f48f-3462-4f76-9b8b-6fc438d40b82 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:11.549113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING keystone.server.flask.application [None req-c267f48f-3462-4f76-9b8b-6fc438d40b82 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 12 00:16:11.550698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 643/1304] 10.222.0.32 () {56 vars in 1117 bytes} [Tue Apr 12 00:16:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 12 00:16:11.556492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4772ecb-9884-45da-a90f-aa43361d6899 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:11.647994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4772ecb-9884-45da-a90f-aa43361d6899 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:11.679947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d500cb-dc83-4f3f-bd55-94236a610235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:11.680601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d500cb-dc83-4f3f-bd55-94236a610235 None admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:11.680882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d500cb-dc83-4f3f-bd55-94236a610235 None admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:11.681155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d500cb-dc83-4f3f-bd55-94236a610235 None admin] PATH_INFO: `/v3/services` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:11.681844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d500cb-dc83-4f3f-bd55-94236a610235 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:16:11.682143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d500cb-dc83-4f3f-bd55-94236a610235 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:11.683521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d500cb-dc83-4f3f-bd55-94236a610235 None admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:11.688381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 662/1305] 10.222.0.32 () {56 vars in 1116 bytes} [Tue Apr 12 00:16:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:16:11.694570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267f48f-3462-4f76-9b8b-6fc438d40b82 None admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:16:11.784877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267f48f-3462-4f76-9b8b-6fc438d40b82 None admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:16:11.815607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b221ae5-d570-401e-aac5-ae034fa6ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:16:11.816183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b221ae5-d570-401e-aac5-ae034fa6ae11 None admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:16:11.816462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b221ae5-d570-401e-aac5-ae034fa6ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:16:11.816734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b221ae5-d570-401e-aac5-ae034fa6ae11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:16:11.817449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b221ae5-d570-401e-aac5-ae034fa6ae11 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:16:11.818875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b221ae5-d570-401e-aac5-ae034fa6ae11 None admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:16:11.836346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 644/1306] 10.222.0.32 () {60 vars in 1144 bytes} [Tue Apr 12 00:16:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:17:15.313879 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8f95-252a-451b-8475-5c28083c9407 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:15.314503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8f95-252a-451b-8475-5c28083c9407 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:15.314503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8f95-252a-451b-8475-5c28083c9407 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:15.315946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 663/1307] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:15.321277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81713f71-ec99-40a2-b630-3ebb3bbe909a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:15.322161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81713f71-ec99-40a2-b630-3ebb3bbe909a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:15.322723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81713f71-ec99-40a2-b630-3ebb3bbe909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:15.397928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-81713f71-ec99-40a2-b630-3ebb3bbe909a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:15.399579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-81713f71-ec99-40a2-b630-3ebb3bbe909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:15.518387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 645/1308] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:15.565014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a36b47-2251-4c8f-b392-2c94d966c4db None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:15.565789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a36b47-2251-4c8f-b392-2c94d966c4db None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:15.566310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a36b47-2251-4c8f-b392-2c94d966c4db None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:15.568002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 664/1309] 10.222.0.32 () {54 vars in 964 bytes} [Tue Apr 12 00:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:15.574273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d7d38-4b8c-4617-9e2e-63486c0f15d1 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:15.574562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d7d38-4b8c-4617-9e2e-63486c0f15d1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:15.574843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d7d38-4b8c-4617-9e2e-63486c0f15d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:15.723022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ff4d7d38-4b8c-4617-9e2e-63486c0f15d1 None None] MFA Rules not processed for user `a99a9951d83446efbf819b72836afc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:15.724213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ff4d7d38-4b8c-4617-9e2e-63486c0f15d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:15.834329 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 646/1310] 10.222.0.32 () {58 vars in 1061 bytes} [Tue Apr 12 00:17:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:15.835077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a36b47-2251-4c8f-b392-2c94d966c4db None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:15.836847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-71a36b47-2251-4c8f-b392-2c94d966c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:16.033807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a36b47-2251-4c8f-b392-2c94d966c4db None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:16.108105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397b676-b974-4082-8003-1a5a6cb109c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:16.109622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397b676-b974-4082-8003-1a5a6cb109c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:16.110110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397b676-b974-4082-8003-1a5a6cb109c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:16.110579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397b676-b974-4082-8003-1a5a6cb109c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:16.112366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3397b676-b974-4082-8003-1a5a6cb109c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:16.240658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397b676-b974-4082-8003-1a5a6cb109c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:16.242411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397b676-b974-4082-8003-1a5a6cb109c7 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:16.262153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 665/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:17:18.907386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362f25-ac9e-408b-9996-84da3d657e52 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:18.907953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362f25-ac9e-408b-9996-84da3d657e52 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:18.907953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33362f25-ac9e-408b-9996-84da3d657e52 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:18.909298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 647/1312] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:18.914508 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31fb68-cccd-45f1-b1e5-c02aec9aeee5 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:18.914916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31fb68-cccd-45f1-b1e5-c02aec9aeee5 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:18.915077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31fb68-cccd-45f1-b1e5-c02aec9aeee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:18.998125 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5d31fb68-cccd-45f1-b1e5-c02aec9aeee5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:18.999780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5d31fb68-cccd-45f1-b1e5-c02aec9aeee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:19.094375 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 666/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:19.132712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362f25-ac9e-408b-9996-84da3d657e52 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:19.134358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-33362f25-ac9e-408b-9996-84da3d657e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:19.233475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33362f25-ac9e-408b-9996-84da3d657e52 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:19.302350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4cc32-e228-41e1-ab9a-55913c06c971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:19.303077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4cc32-e228-41e1-ab9a-55913c06c971 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:19.303366 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4cc32-e228-41e1-ab9a-55913c06c971 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:19.303641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4cc32-e228-41e1-ab9a-55913c06c971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:19.305265 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-46b4cc32-e228-41e1-ab9a-55913c06c971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:19.411592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4cc32-e228-41e1-ab9a-55913c06c971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:19.413045 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4cc32-e228-41e1-ab9a-55913c06c971 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:19.429857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 648/1314] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:22.013158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800d504-c3e7-4664-8d6a-d508f476e597 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:22.013709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800d504-c3e7-4664-8d6a-d508f476e597 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:22.013709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800d504-c3e7-4664-8d6a-d508f476e597 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:22.015617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 667/1315] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:22.020854 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872378fb-fb3d-4a17-bbbf-5903036334af None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:22.021235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872378fb-fb3d-4a17-bbbf-5903036334af None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:22.021401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872378fb-fb3d-4a17-bbbf-5903036334af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:22.083491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-872378fb-fb3d-4a17-bbbf-5903036334af None None] MFA Rules not processed for user `f75b0fefc7e946f3a9e33757e996c8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:22.084707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-872378fb-fb3d-4a17-bbbf-5903036334af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:22.175238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 649/1316] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:22.215149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800d504-c3e7-4664-8d6a-d508f476e597 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:22.216648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a800d504-c3e7-4664-8d6a-d508f476e597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:22.314700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800d504-c3e7-4664-8d6a-d508f476e597 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:22.384432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053fb8c2-2745-4db7-b66b-9d3fe98b8db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:22.385085 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fb8c2-2745-4db7-b66b-9d3fe98b8db6 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:22.385366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fb8c2-2745-4db7-b66b-9d3fe98b8db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:22.385638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053fb8c2-2745-4db7-b66b-9d3fe98b8db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:22.387275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-053fb8c2-2745-4db7-b66b-9d3fe98b8db6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:22.487383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fb8c2-2745-4db7-b66b-9d3fe98b8db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:22.488793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053fb8c2-2745-4db7-b66b-9d3fe98b8db6 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:22.507718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 668/1317] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:25.313627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc440f6-04a5-4348-b22f-380e3a441e60 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:25.314162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc440f6-04a5-4348-b22f-380e3a441e60 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:25.314162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc440f6-04a5-4348-b22f-380e3a441e60 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:25.315573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 650/1318] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:25.320676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a42a3-aba0-430f-8d63-b5c8927fa76a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:25.321111 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a42a3-aba0-430f-8d63-b5c8927fa76a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:25.321261 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a42a3-aba0-430f-8d63-b5c8927fa76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:25.386637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a03a42a3-aba0-430f-8d63-b5c8927fa76a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:25.387858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a03a42a3-aba0-430f-8d63-b5c8927fa76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:25.477935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 669/1319] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:25.517218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc440f6-04a5-4348-b22f-380e3a441e60 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:25.518784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6bc440f6-04a5-4348-b22f-380e3a441e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:25.618707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc440f6-04a5-4348-b22f-380e3a441e60 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:25.687803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942352c-e4ca-48b7-87d7-16a20a245788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:25.688443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942352c-e4ca-48b7-87d7-16a20a245788 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:25.688719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942352c-e4ca-48b7-87d7-16a20a245788 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:25.688989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942352c-e4ca-48b7-87d7-16a20a245788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:25.690618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f942352c-e4ca-48b7-87d7-16a20a245788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:25.791846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942352c-e4ca-48b7-87d7-16a20a245788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:25.793248 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942352c-e4ca-48b7-87d7-16a20a245788 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:25.809987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 651/1320] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:28.747451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa1cb8-7386-42a9-859a-9d3b64c1ff1c None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:28.747970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa1cb8-7386-42a9-859a-9d3b64c1ff1c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:28.748088 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa1cb8-7386-42a9-859a-9d3b64c1ff1c None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:28.749400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 670/1321] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:28.755121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3106ea-f9f3-4665-a7a1-3ae870e99c0c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:28.755506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3106ea-f9f3-4665-a7a1-3ae870e99c0c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:28.755685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3106ea-f9f3-4665-a7a1-3ae870e99c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:28.817698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-4e3106ea-f9f3-4665-a7a1-3ae870e99c0c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:28.818916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4e3106ea-f9f3-4665-a7a1-3ae870e99c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:28.909588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 652/1322] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:28.947492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa1cb8-7386-42a9-859a-9d3b64c1ff1c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:28.949026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-69aa1cb8-7386-42a9-859a-9d3b64c1ff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:29.045985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa1cb8-7386-42a9-859a-9d3b64c1ff1c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:29.116929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5be60a-99a2-4a53-ad2f-687b38a119a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:29.117571 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5be60a-99a2-4a53-ad2f-687b38a119a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:29.117849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5be60a-99a2-4a53-ad2f-687b38a119a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:29.118122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5be60a-99a2-4a53-ad2f-687b38a119a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:29.119758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ba5be60a-99a2-4a53-ad2f-687b38a119a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:29.222852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5be60a-99a2-4a53-ad2f-687b38a119a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:29.224219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5be60a-99a2-4a53-ad2f-687b38a119a5 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:29.242137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 671/1323] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:31.564493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0151-58b4-4189-947d-16930c104864 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:31.565028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0151-58b4-4189-947d-16930c104864 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:31.565028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c0151-58b4-4189-947d-16930c104864 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:31.566445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 653/1324] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:31.571705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f445a-ff30-46b5-bb95-aca6b5a2009a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:31.572150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f445a-ff30-46b5-bb95-aca6b5a2009a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:31.572395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f445a-ff30-46b5-bb95-aca6b5a2009a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:31.641244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-443f445a-ff30-46b5-bb95-aca6b5a2009a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:31.642573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-443f445a-ff30-46b5-bb95-aca6b5a2009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:31.739591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 672/1325] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:31.791936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba3a06-e236-4c0a-b20f-cec279d60e28 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:31.792311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba3a06-e236-4c0a-b20f-cec279d60e28 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:31.792655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba3a06-e236-4c0a-b20f-cec279d60e28 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:31.794110 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 654/1326] 10.222.0.32 () {54 vars in 964 bytes} [Tue Apr 12 00:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:31.801014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d526e-509e-488a-9dde-b775752f7377 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:31.801312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d526e-509e-488a-9dde-b775752f7377 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:31.801598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d526e-509e-488a-9dde-b775752f7377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:31.874269 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a24d526e-509e-488a-9dde-b775752f7377 None None] MFA Rules not processed for user `a99a9951d83446efbf819b72836afc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:31.876081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a24d526e-509e-488a-9dde-b775752f7377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:31.952941 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 673/1327] 10.222.0.32 () {58 vars in 1061 bytes} [Tue Apr 12 00:17:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:17:31.961887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba3a06-e236-4c0a-b20f-cec279d60e28 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:31.963418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-37ba3a06-e236-4c0a-b20f-cec279d60e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:32.066488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba3a06-e236-4c0a-b20f-cec279d60e28 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:32.135140 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e38b99-ec54-421b-860b-47673050cb92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:32.135781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e38b99-ec54-421b-860b-47673050cb92 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:32.136061 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e38b99-ec54-421b-860b-47673050cb92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:32.136335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e38b99-ec54-421b-860b-47673050cb92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:32.137940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d5e38b99-ec54-421b-860b-47673050cb92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:32.243280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e38b99-ec54-421b-860b-47673050cb92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:32.244770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e38b99-ec54-421b-860b-47673050cb92 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:32.262548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 655/1328] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:34.833687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302b07-a5ca-44b6-a740-86c2a6a6f30b None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:34.834218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302b07-a5ca-44b6-a740-86c2a6a6f30b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:34.834218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72302b07-a5ca-44b6-a740-86c2a6a6f30b None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:34.835648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 674/1329] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:34.841015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237ab4-fcbe-484b-999c-9b3845767512 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:34.841407 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237ab4-fcbe-484b-999c-9b3845767512 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:34.841589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52237ab4-fcbe-484b-999c-9b3845767512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:34.905620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-52237ab4-fcbe-484b-999c-9b3845767512 None None] MFA Rules not processed for user `f75b0fefc7e946f3a9e33757e996c8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:34.906831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-52237ab4-fcbe-484b-999c-9b3845767512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:34.998203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 656/1330] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:35.036377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72302b07-a5ca-44b6-a740-86c2a6a6f30b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:35.037901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-72302b07-a5ca-44b6-a740-86c2a6a6f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:35.135482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72302b07-a5ca-44b6-a740-86c2a6a6f30b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:35.204588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84205a5f-527d-4b13-9bd5-ca78140c55d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:35.205231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205a5f-527d-4b13-9bd5-ca78140c55d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:35.205509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205a5f-527d-4b13-9bd5-ca78140c55d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:35.205781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205a5f-527d-4b13-9bd5-ca78140c55d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:35.207418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-84205a5f-527d-4b13-9bd5-ca78140c55d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:35.311097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84205a5f-527d-4b13-9bd5-ca78140c55d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:35.312972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84205a5f-527d-4b13-9bd5-ca78140c55d8 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:35.331339 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 675/1331] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:38.023838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e95bf-f5fc-4074-ba12-b496176d73e1 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:38.024347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e95bf-f5fc-4074-ba12-b496176d73e1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:38.024470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e95bf-f5fc-4074-ba12-b496176d73e1 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:38.025765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 657/1332] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:38.031713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714a1d-984a-4fd7-88e5-4e44aac7d066 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:38.032462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714a1d-984a-4fd7-88e5-4e44aac7d066 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:38.032553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714a1d-984a-4fd7-88e5-4e44aac7d066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:38.098120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-83714a1d-984a-4fd7-88e5-4e44aac7d066 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:38.099355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-83714a1d-984a-4fd7-88e5-4e44aac7d066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:38.190848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 676/1333] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:38.227667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e95bf-f5fc-4074-ba12-b496176d73e1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:38.229205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e35e95bf-f5fc-4074-ba12-b496176d73e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:38.329218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e95bf-f5fc-4074-ba12-b496176d73e1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:38.401577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afd96c-e5b5-460e-9675-5824159eb7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:38.402153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afd96c-e5b5-460e-9675-5824159eb7ac service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:38.402478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afd96c-e5b5-460e-9675-5824159eb7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:38.402757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afd96c-e5b5-460e-9675-5824159eb7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:38.404388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b8afd96c-e5b5-460e-9675-5824159eb7ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:38.509214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afd96c-e5b5-460e-9675-5824159eb7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:38.510676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afd96c-e5b5-460e-9675-5824159eb7ac service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:38.527654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 658/1334] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:40.875733 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eb71f-f91e-4e00-af53-fe350d122dc7 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:40.876319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eb71f-f91e-4e00-af53-fe350d122dc7 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:40.876319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24eb71f-f91e-4e00-af53-fe350d122dc7 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:40.877695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 677/1335] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:40.882778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5da3b-0a1d-4c9a-922a-6131855ea8d2 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:40.883179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5da3b-0a1d-4c9a-922a-6131855ea8d2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:40.883332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5da3b-0a1d-4c9a-922a-6131855ea8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:40.946275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-13d5da3b-0a1d-4c9a-922a-6131855ea8d2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:40.947470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-13d5da3b-0a1d-4c9a-922a-6131855ea8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:41.038791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 659/1336] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:41.080485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eb71f-f91e-4e00-af53-fe350d122dc7 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:41.082001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f24eb71f-f91e-4e00-af53-fe350d122dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:41.180033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24eb71f-f91e-4e00-af53-fe350d122dc7 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:41.248074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625b803-b8f0-4274-acb9-c89ec9c79cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:41.248643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625b803-b8f0-4274-acb9-c89ec9c79cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:41.248927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625b803-b8f0-4274-acb9-c89ec9c79cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:41.249693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625b803-b8f0-4274-acb9-c89ec9c79cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:41.251323 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7625b803-b8f0-4274-acb9-c89ec9c79cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:41.352102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625b803-b8f0-4274-acb9-c89ec9c79cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:41.353507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625b803-b8f0-4274-acb9-c89ec9c79cb3 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:41.370336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 678/1337] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:43.943979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1e267-1b60-4d48-9289-392ca0e61cf8 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:43.944525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1e267-1b60-4d48-9289-392ca0e61cf8 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:43.944525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1e267-1b60-4d48-9289-392ca0e61cf8 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:43.945898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 660/1338] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:17:43.951245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9b289-d937-49e6-a803-fed930b3bd7b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:43.951659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9b289-d937-49e6-a803-fed930b3bd7b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:43.951790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9b289-d937-49e6-a803-fed930b3bd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:44.016549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-42c9b289-d937-49e6-a803-fed930b3bd7b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:44.017721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-42c9b289-d937-49e6-a803-fed930b3bd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:44.109250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 679/1339] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:44.145102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1e267-1b60-4d48-9289-392ca0e61cf8 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:44.146656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-82b1e267-1b60-4d48-9289-392ca0e61cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:44.243633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1e267-1b60-4d48-9289-392ca0e61cf8 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:44.312327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5aeaa1-a801-47d7-97dd-aa95ff76ec27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:44.312953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aeaa1-a801-47d7-97dd-aa95ff76ec27 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:44.313231 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aeaa1-a801-47d7-97dd-aa95ff76ec27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:44.313503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5aeaa1-a801-47d7-97dd-aa95ff76ec27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:44.315111 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ec5aeaa1-a801-47d7-97dd-aa95ff76ec27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:44.420491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aeaa1-a801-47d7-97dd-aa95ff76ec27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:44.421939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5aeaa1-a801-47d7-97dd-aa95ff76ec27 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:44.439277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 661/1340] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:48.724261 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183532e-4f72-46c4-9b13-6786c650d326 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:48.724795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183532e-4f72-46c4-9b13-6786c650d326 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:48.725001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183532e-4f72-46c4-9b13-6786c650d326 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:48.726482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 680/1341] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:48.731703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33284e89-eb2c-4350-8532-ac4f809f3314 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:48.732088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33284e89-eb2c-4350-8532-ac4f809f3314 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:48.732262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33284e89-eb2c-4350-8532-ac4f809f3314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:48.800399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-33284e89-eb2c-4350-8532-ac4f809f3314 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:48.801574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-33284e89-eb2c-4350-8532-ac4f809f3314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:48.909002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 662/1342] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:48.948822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183532e-4f72-46c4-9b13-6786c650d326 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:48.950971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2183532e-4f72-46c4-9b13-6786c650d326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:49.043103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183532e-4f72-46c4-9b13-6786c650d326 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:49.047128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082ddfe-b09f-4f39-9238-305bd7e4f894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:49.047767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082ddfe-b09f-4f39-9238-305bd7e4f894 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:49.048049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082ddfe-b09f-4f39-9238-305bd7e4f894 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:49.048324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082ddfe-b09f-4f39-9238-305bd7e4f894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:49.056995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082ddfe-b09f-4f39-9238-305bd7e4f894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:49.058431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082ddfe-b09f-4f39-9238-305bd7e4f894 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:49.067908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 681/1343] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:51.991118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e3a0b-5372-447b-b114-bd7212549ab0 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:51.991694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e3a0b-5372-447b-b114-bd7212549ab0 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:51.991694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e3a0b-5372-447b-b114-bd7212549ab0 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:51.993046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 663/1344] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:51.998330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083653a-126b-4ba6-a568-4e47ba154224 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:51.998735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083653a-126b-4ba6-a568-4e47ba154224 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:51.998897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8083653a-126b-4ba6-a568-4e47ba154224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:52.025662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-8083653a-126b-4ba6-a568-4e47ba154224 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:52.026867 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8083653a-126b-4ba6-a568-4e47ba154224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:52.101075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 682/1345] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:52.140367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e3a0b-5372-447b-b114-bd7212549ab0 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:52.150845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e3a0b-5372-447b-b114-bd7212549ab0 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:52.154393 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d1aaf9-b042-401f-8ae7-e205700e9ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:52.155118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1aaf9-b042-401f-8ae7-e205700e9ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:52.156048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1aaf9-b042-401f-8ae7-e205700e9ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:52.156386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d1aaf9-b042-401f-8ae7-e205700e9ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:52.165577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1aaf9-b042-401f-8ae7-e205700e9ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:52.167029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d1aaf9-b042-401f-8ae7-e205700e9ca5 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:52.176492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 664/1346] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:56.441081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e770e-737e-409e-b43f-a8d184eb3af6 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:56.441591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e770e-737e-409e-b43f-a8d184eb3af6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:56.441686 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e770e-737e-409e-b43f-a8d184eb3af6 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:56.443037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 683/1347] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:17:56.448265 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83223-41b9-4feb-9704-fdcbe8f667ac None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:56.448683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83223-41b9-4feb-9704-fdcbe8f667ac None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:56.448950 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa83223-41b9-4feb-9704-fdcbe8f667ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:56.466594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6fa83223-41b9-4feb-9704-fdcbe8f667ac None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:17:56.467802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6fa83223-41b9-4feb-9704-fdcbe8f667ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:56.475605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 665/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:17:56.513787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e770e-737e-409e-b43f-a8d184eb3af6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:56.524353 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e770e-737e-409e-b43f-a8d184eb3af6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:56.527800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c50b67-a08d-4b28-b493-76a4ba592868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:56.528430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c50b67-a08d-4b28-b493-76a4ba592868 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:56.528712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c50b67-a08d-4b28-b493-76a4ba592868 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:56.528985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c50b67-a08d-4b28-b493-76a4ba592868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:56.537969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c50b67-a08d-4b28-b493-76a4ba592868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:56.539408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c50b67-a08d-4b28-b493-76a4ba592868 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:56.549092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 684/1349] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:18:01.951317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469150ff-dc1e-4cc8-9cc2-834f35b2acb8 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:01.951794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469150ff-dc1e-4cc8-9cc2-834f35b2acb8 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:01.951872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469150ff-dc1e-4cc8-9cc2-834f35b2acb8 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:01.954066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 666/1350] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:01.959255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92df7b-94ce-4b75-96bf-b82baa00f490 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:01.959662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92df7b-94ce-4b75-96bf-b82baa00f490 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:01.959808 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92df7b-94ce-4b75-96bf-b82baa00f490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:02.033478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ef92df7b-94ce-4b75-96bf-b82baa00f490 None None] MFA Rules not processed for user `92588782f32a472193340aba2bff8d78`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:02.034935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ef92df7b-94ce-4b75-96bf-b82baa00f490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:02.180132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 685/1351] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:18:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:06.407497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805c35c-3193-477f-be76-176c41d722ab None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:06.408408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805c35c-3193-477f-be76-176c41d722ab None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:06.408671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805c35c-3193-477f-be76-176c41d722ab None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:06.410198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 667/1352] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:06.415301 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba735-14b6-4925-8a0f-e9c67a4d4f32 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:06.416168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba735-14b6-4925-8a0f-e9c67a4d4f32 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:06.416668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cba735-14b6-4925-8a0f-e9c67a4d4f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:06.435398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b6cba735-14b6-4925-8a0f-e9c67a4d4f32 None None] MFA Rules not processed for user `92588782f32a472193340aba2bff8d78`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:06.436648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b6cba735-14b6-4925-8a0f-e9c67a4d4f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:06.445813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 686/1353] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:18:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:07.927861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c06294-ebc0-4120-b69d-f6467969b3e6 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:07.928369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c06294-ebc0-4120-b69d-f6467969b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:07.928449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c06294-ebc0-4120-b69d-f6467969b3e6 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:07.929775 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 668/1354] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:07.934738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e1ca5-e5ed-4981-984c-6d0df263fc51 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:07.935189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e1ca5-e5ed-4981-984c-6d0df263fc51 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:07.935325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e1ca5-e5ed-4981-984c-6d0df263fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:07.954758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-156e1ca5-e5ed-4981-984c-6d0df263fc51 None None] MFA Rules not processed for user `92588782f32a472193340aba2bff8d78`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:07.955942 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-156e1ca5-e5ed-4981-984c-6d0df263fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:07.964600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 687/1355] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:18:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:11.991451 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb02c3-a6d2-4f35-a17b-5c3bf5507cbf None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:11.992039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb02c3-a6d2-4f35-a17b-5c3bf5507cbf None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:11.992039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb02c3-a6d2-4f35-a17b-5c3bf5507cbf None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:11.993467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 669/1356] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:11.998479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaee43-8d0f-41cd-8767-5ae5982a1425 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:11.998971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaee43-8d0f-41cd-8767-5ae5982a1425 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:11.999060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaee43-8d0f-41cd-8767-5ae5982a1425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:12.015963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f6eaee43-8d0f-41cd-8767-5ae5982a1425 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:12.017112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f6eaee43-8d0f-41cd-8767-5ae5982a1425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:12.024684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 688/1357] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:12.073476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b896-60cb-485b-8160-5e500ab55bd5 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:12.073881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b896-60cb-485b-8160-5e500ab55bd5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:12.074279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b896-60cb-485b-8160-5e500ab55bd5 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:12.075843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 670/1358] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 00:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:12.081150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5e679-c089-43c7-b56c-3a691aa4aa8a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:12.081445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5e679-c089-43c7-b56c-3a691aa4aa8a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:12.081724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5e679-c089-43c7-b56c-3a691aa4aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:12.133608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2ad5e679-c089-43c7-b56c-3a691aa4aa8a None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:12.134816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2ad5e679-c089-43c7-b56c-3a691aa4aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:12.217365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 689/1359] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 00:18:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:12.225475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b896-60cb-485b-8160-5e500ab55bd5 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:12.240168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b896-60cb-485b-8160-5e500ab55bd5 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:12.245586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c4aa7-8195-4d50-834c-c0a9838a4d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:12.246273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c4aa7-8195-4d50-834c-c0a9838a4d88 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:12.246618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c4aa7-8195-4d50-834c-c0a9838a4d88 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:12.246955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c4aa7-8195-4d50-834c-c0a9838a4d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:12.255939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c4aa7-8195-4d50-834c-c0a9838a4d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:12.257561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c4aa7-8195-4d50-834c-c0a9838a4d88 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:12.267365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 671/1360] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:14.777466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cb8bd-8cb3-4b44-a13d-d1ce5b0faba1 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:14.778028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cb8bd-8cb3-4b44-a13d-d1ce5b0faba1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:14.778028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cb8bd-8cb3-4b44-a13d-d1ce5b0faba1 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:14.779392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 690/1361] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:14.785532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07f2e-711e-4975-8253-7cb75748ec28 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:14.785954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07f2e-711e-4975-8253-7cb75748ec28 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:14.786146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07f2e-711e-4975-8253-7cb75748ec28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:14.803447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-bed07f2e-711e-4975-8253-7cb75748ec28 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:14.805176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bed07f2e-711e-4975-8253-7cb75748ec28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:14.813084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 672/1362] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:14.858017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cb8bd-8cb3-4b44-a13d-d1ce5b0faba1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:14.872907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cb8bd-8cb3-4b44-a13d-d1ce5b0faba1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:14.879109 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49d7f5-90fe-483f-968c-48ab0e9fab35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:14.879758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49d7f5-90fe-483f-968c-48ab0e9fab35 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:14.880043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49d7f5-90fe-483f-968c-48ab0e9fab35 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:14.880319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49d7f5-90fe-483f-968c-48ab0e9fab35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:14.888835 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49d7f5-90fe-483f-968c-48ab0e9fab35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:14.891035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49d7f5-90fe-483f-968c-48ab0e9fab35 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:14.901898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 691/1363] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:17.507215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0024b-68b4-46f1-9542-72c63e18d7db None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:17.507643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0024b-68b4-46f1-9542-72c63e18d7db None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:17.507758 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0024b-68b4-46f1-9542-72c63e18d7db None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:17.509139 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 673/1364] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:17.514894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52937-4f1a-4b13-98bb-1eaa1e0d7e73 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:17.515314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52937-4f1a-4b13-98bb-1eaa1e0d7e73 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:17.515506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52937-4f1a-4b13-98bb-1eaa1e0d7e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:17.535394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f4b52937-4f1a-4b13-98bb-1eaa1e0d7e73 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:17.536567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f4b52937-4f1a-4b13-98bb-1eaa1e0d7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:17.544549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 692/1365] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:17.591531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79deb-e260-45f2-9c89-81226ec4084b None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:17.591822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79deb-e260-45f2-9c89-81226ec4084b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:17.592101 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e79deb-e260-45f2-9c89-81226ec4084b None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:17.593983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 674/1366] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 00:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:17.599281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb6c8-bdb6-4775-9db6-99ba0df05991 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:17.599593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb6c8-bdb6-4775-9db6-99ba0df05991 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:17.599855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eb6c8-bdb6-4775-9db6-99ba0df05991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:17.618414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-325eb6c8-bdb6-4775-9db6-99ba0df05991 None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:17.619650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-325eb6c8-bdb6-4775-9db6-99ba0df05991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:17.628769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 693/1367] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 00:18:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:17.636412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79deb-e260-45f2-9c89-81226ec4084b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:17.651509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e79deb-e260-45f2-9c89-81226ec4084b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:17.662092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b029f8-5b48-4070-876f-98e8cbad9794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:17.662881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b029f8-5b48-4070-876f-98e8cbad9794 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:17.663246 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b029f8-5b48-4070-876f-98e8cbad9794 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:17.663598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b029f8-5b48-4070-876f-98e8cbad9794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:17.672510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b029f8-5b48-4070-876f-98e8cbad9794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:17.674089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b029f8-5b48-4070-876f-98e8cbad9794 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:17.686308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 675/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:20.065422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a425-b803-4ad7-adfe-8754d5b20838 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:20.065998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a425-b803-4ad7-adfe-8754d5b20838 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:20.065998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640a425-b803-4ad7-adfe-8754d5b20838 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:20.067430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 694/1369] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:20.073464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a71d3e-e593-481c-a7c6-3c14af769833 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:20.074032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a71d3e-e593-481c-a7c6-3c14af769833 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:20.074032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a71d3e-e593-481c-a7c6-3c14af769833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:20.091917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a0a71d3e-e593-481c-a7c6-3c14af769833 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:20.093664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a0a71d3e-e593-481c-a7c6-3c14af769833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:20.101626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 676/1370] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:20.147871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a425-b803-4ad7-adfe-8754d5b20838 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:20.162613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640a425-b803-4ad7-adfe-8754d5b20838 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:20.168140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959151b-91a4-4e45-85c7-8c305908b6a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:20.169043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959151b-91a4-4e45-85c7-8c305908b6a3 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:20.169417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959151b-91a4-4e45-85c7-8c305908b6a3 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:20.169789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959151b-91a4-4e45-85c7-8c305908b6a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:20.178531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959151b-91a4-4e45-85c7-8c305908b6a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:20.180202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959151b-91a4-4e45-85c7-8c305908b6a3 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:20.190529 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 695/1371] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:18:20.201436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4dc44-d962-40af-bfa3-08ff5479acea None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:20.201723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4dc44-d962-40af-bfa3-08ff5479acea None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:20.202851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4dc44-d962-40af-bfa3-08ff5479acea None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:20.204262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 677/1372] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:18:20.210935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafa0df-89ee-48f4-bb0a-79a30c5e4b78 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:20.211222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafa0df-89ee-48f4-bb0a-79a30c5e4b78 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:20.211495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafa0df-89ee-48f4-bb0a-79a30c5e4b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:20.238021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-7eafa0df-89ee-48f4-bb0a-79a30c5e4b78 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:20.239387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7eafa0df-89ee-48f4-bb0a-79a30c5e4b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:20.250337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 696/1373] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:18:20.585694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32a48f-b530-4830-b176-67f196cbc4ce None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:20.585996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32a48f-b530-4830-b176-67f196cbc4ce None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:20.586523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32a48f-b530-4830-b176-67f196cbc4ce None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:20.587888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 678/1374] 10.222.0.32 () {54 vars in 962 bytes} [Tue Apr 12 00:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:20.592941 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe75a-9f79-4dee-9d05-801c974f58ee None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:20.593235 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe75a-9f79-4dee-9d05-801c974f58ee None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:20.593635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe75a-9f79-4dee-9d05-801c974f58ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:20.642601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-97dfe75a-9f79-4dee-9d05-801c974f58ee None None] MFA Rules not processed for user `73a39479834440ffa85fbc0d58a257d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:20.643849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-97dfe75a-9f79-4dee-9d05-801c974f58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:20.710692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 697/1375] 10.222.0.32 () {58 vars in 1059 bytes} [Tue Apr 12 00:18:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:18:20.719293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32a48f-b530-4830-b176-67f196cbc4ce None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:20.729863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32a48f-b530-4830-b176-67f196cbc4ce None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:20.733538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de172a58-eec9-4b6c-af46-f97a5a8b1834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:20.734331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172a58-eec9-4b6c-af46-f97a5a8b1834 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:20.734716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172a58-eec9-4b6c-af46-f97a5a8b1834 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:20.735091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172a58-eec9-4b6c-af46-f97a5a8b1834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:20.744164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de172a58-eec9-4b6c-af46-f97a5a8b1834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:20.745694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de172a58-eec9-4b6c-af46-f97a5a8b1834 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:20.755219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 679/1376] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:18:22.558469 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b6b47-fc65-4dd4-a4ad-90a1a189b2b4 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:22.559017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b6b47-fc65-4dd4-a4ad-90a1a189b2b4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:22.559017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b6b47-fc65-4dd4-a4ad-90a1a189b2b4 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:22.560347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 698/1377] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:22.566571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce6a48-ed41-4172-954e-5b0b4d641c10 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:22.567088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce6a48-ed41-4172-954e-5b0b4d641c10 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:22.567208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce6a48-ed41-4172-954e-5b0b4d641c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:22.585896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a7ce6a48-ed41-4172-954e-5b0b4d641c10 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:22.587167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a7ce6a48-ed41-4172-954e-5b0b4d641c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:22.595942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 680/1378] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:22.642738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b6b47-fc65-4dd4-a4ad-90a1a189b2b4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:22.658632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b6b47-fc65-4dd4-a4ad-90a1a189b2b4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:22.664327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cc3fb-e516-41a7-877c-1226090a4f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:22.665107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cc3fb-e516-41a7-877c-1226090a4f83 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:22.665490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cc3fb-e516-41a7-877c-1226090a4f83 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:22.666001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cc3fb-e516-41a7-877c-1226090a4f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:22.676296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cc3fb-e516-41a7-877c-1226090a4f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:22.678064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cc3fb-e516-41a7-877c-1226090a4f83 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:22.687441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 699/1379] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:25.039654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c175c-ae8c-42ab-a20f-d28901c89071 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:25.040472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c175c-ae8c-42ab-a20f-d28901c89071 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:25.040472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c175c-ae8c-42ab-a20f-d28901c89071 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:25.042099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 681/1380] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:25.047880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf72ca-a872-4163-892a-476d40241ea5 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:25.048327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf72ca-a872-4163-892a-476d40241ea5 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:25.048421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf72ca-a872-4163-892a-476d40241ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:25.066749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e9bf72ca-a872-4163-892a-476d40241ea5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:25.067925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e9bf72ca-a872-4163-892a-476d40241ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:25.076015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 700/1381] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:18:25.120872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c175c-ae8c-42ab-a20f-d28901c89071 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:25.135535 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c175c-ae8c-42ab-a20f-d28901c89071 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:25.140949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6b0f1-5dc3-4fdf-9970-a763d8d0006a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:25.141771 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6b0f1-5dc3-4fdf-9970-a763d8d0006a service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:25.142054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6b0f1-5dc3-4fdf-9970-a763d8d0006a service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:25.142358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6b0f1-5dc3-4fdf-9970-a763d8d0006a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:25.150489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6b0f1-5dc3-4fdf-9970-a763d8d0006a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:25.152051 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6b0f1-5dc3-4fdf-9970-a763d8d0006a service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:25.161464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 682/1382] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:27.467611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1681717-0631-4215-8716-6e17fde25702 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:27.468489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1681717-0631-4215-8716-6e17fde25702 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:27.468775 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1681717-0631-4215-8716-6e17fde25702 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:27.470142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 701/1383] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:27.475438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9c8d-53e7-4b8f-a475-6d7e7b3a91d5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:27.475867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9c8d-53e7-4b8f-a475-6d7e7b3a91d5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:27.476015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9c8d-53e7-4b8f-a475-6d7e7b3a91d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:27.494778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c1ea9c8d-53e7-4b8f-a475-6d7e7b3a91d5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:27.496116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c1ea9c8d-53e7-4b8f-a475-6d7e7b3a91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:27.505050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 683/1384] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:18:27.548792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1681717-0631-4215-8716-6e17fde25702 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:27.564515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1681717-0631-4215-8716-6e17fde25702 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:27.571106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81f909-0c95-412f-82e8-c0f32cfaea4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:27.572049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81f909-0c95-412f-82e8-c0f32cfaea4d service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:27.572497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81f909-0c95-412f-82e8-c0f32cfaea4d service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:27.572928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81f909-0c95-412f-82e8-c0f32cfaea4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:27.582750 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81f909-0c95-412f-82e8-c0f32cfaea4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:27.584487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81f909-0c95-412f-82e8-c0f32cfaea4d service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:27.596135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 702/1385] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:29.930794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb7df-4b71-44ce-accf-e9b4cb154e7f None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:29.931328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb7df-4b71-44ce-accf-e9b4cb154e7f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:29.931423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefb7df-4b71-44ce-accf-e9b4cb154e7f None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:29.932815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 684/1386] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:29.939651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aacd94-292d-4092-a11b-cb42c8a6d33d None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:29.940059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aacd94-292d-4092-a11b-cb42c8a6d33d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:29.940225 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aacd94-292d-4092-a11b-cb42c8a6d33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:29.959040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-36aacd94-292d-4092-a11b-cb42c8a6d33d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:29.960222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-36aacd94-292d-4092-a11b-cb42c8a6d33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:29.968175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 703/1387] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:30.021930 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb7df-4b71-44ce-accf-e9b4cb154e7f None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:30.037114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefb7df-4b71-44ce-accf-e9b4cb154e7f None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:30.042777 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10f96b-5806-4924-8998-ce1cf1af6f47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:30.043442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10f96b-5806-4924-8998-ce1cf1af6f47 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:30.043746 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10f96b-5806-4924-8998-ce1cf1af6f47 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:30.044035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10f96b-5806-4924-8998-ce1cf1af6f47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:30.052431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10f96b-5806-4924-8998-ce1cf1af6f47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:30.054071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10f96b-5806-4924-8998-ce1cf1af6f47 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:30.064173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 685/1388] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:32.413353 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3608-f0a7-4cbd-be3c-5aa0769f5a8b None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:32.413963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3608-f0a7-4cbd-be3c-5aa0769f5a8b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:32.413963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c3608-f0a7-4cbd-be3c-5aa0769f5a8b None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:32.415449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 704/1389] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:32.420441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043a79-330b-411c-a9eb-a28bdb214613 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:32.420884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043a79-330b-411c-a9eb-a28bdb214613 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:32.421074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a043a79-330b-411c-a9eb-a28bdb214613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:32.441826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0a043a79-330b-411c-a9eb-a28bdb214613 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:32.443053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0a043a79-330b-411c-a9eb-a28bdb214613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:32.450905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 686/1390] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:32.501211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c3608-f0a7-4cbd-be3c-5aa0769f5a8b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:32.515839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c3608-f0a7-4cbd-be3c-5aa0769f5a8b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:32.521358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44f275-848c-4d92-988f-488fb222a9d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:32.522058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f275-848c-4d92-988f-488fb222a9d1 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:32.522379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f275-848c-4d92-988f-488fb222a9d1 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:32.522666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44f275-848c-4d92-988f-488fb222a9d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:32.530943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f275-848c-4d92-988f-488fb222a9d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:32.532839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44f275-848c-4d92-988f-488fb222a9d1 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:32.542522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 705/1391] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:34.925018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dad0e-e7e3-4a3d-9253-a528fc8d7e7e None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:34.925589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dad0e-e7e3-4a3d-9253-a528fc8d7e7e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:34.925589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dad0e-e7e3-4a3d-9253-a528fc8d7e7e None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:34.926881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 687/1392] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:34.932058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf065c-a498-409d-a76b-9494172acc93 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:34.932476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf065c-a498-409d-a76b-9494172acc93 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:34.932618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf065c-a498-409d-a76b-9494172acc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:34.949519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-acdf065c-a498-409d-a76b-9494172acc93 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:34.950787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-acdf065c-a498-409d-a76b-9494172acc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:34.958947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 706/1393] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:35.003435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dad0e-e7e3-4a3d-9253-a528fc8d7e7e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:35.018038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7dad0e-e7e3-4a3d-9253-a528fc8d7e7e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:35.023479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95094c8a-af2f-4261-ad9c-435add02bc15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:35.024108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95094c8a-af2f-4261-ad9c-435add02bc15 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:35.024392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95094c8a-af2f-4261-ad9c-435add02bc15 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:35.024669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95094c8a-af2f-4261-ad9c-435add02bc15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:35.033832 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95094c8a-af2f-4261-ad9c-435add02bc15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:35.035471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95094c8a-af2f-4261-ad9c-435add02bc15 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:35.045353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 688/1394] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:36.664469 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5629-5ed2-446b-b69a-11b3903406a7 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:36.665014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5629-5ed2-446b-b69a-11b3903406a7 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:36.665431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce5629-5ed2-446b-b69a-11b3903406a7 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:36.667782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 707/1395] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:36.673664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a8182-dc60-413d-a3e4-c701211ea1df None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:36.674122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a8182-dc60-413d-a3e4-c701211ea1df None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:36.674225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a8182-dc60-413d-a3e4-c701211ea1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:36.691515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b09a8182-dc60-413d-a3e4-c701211ea1df None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:36.692682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b09a8182-dc60-413d-a3e4-c701211ea1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:36.700318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 689/1396] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:18:36.756430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76a281-5206-408c-84c5-a0b0fe611329 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:36.756717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76a281-5206-408c-84c5-a0b0fe611329 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:36.756993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76a281-5206-408c-84c5-a0b0fe611329 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:36.758346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 708/1397] 10.222.0.32 () {54 vars in 961 bytes} [Tue Apr 12 00:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:36.763255 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82569eda-ddcf-4578-b483-f26779ed9188 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:36.763604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82569eda-ddcf-4578-b483-f26779ed9188 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:36.763943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82569eda-ddcf-4578-b483-f26779ed9188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:36.810924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-82569eda-ddcf-4578-b483-f26779ed9188 None None] MFA Rules not processed for user `dfaf01f45e7a429e9361eb176a3f7c38`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:36.812085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-82569eda-ddcf-4578-b483-f26779ed9188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:36.870141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 690/1398] 10.222.0.32 () {58 vars in 1058 bytes} [Tue Apr 12 00:18:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:36.877996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76a281-5206-408c-84c5-a0b0fe611329 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:36.888117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76a281-5206-408c-84c5-a0b0fe611329 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:36.891595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4e77-f796-455f-9bcf-d29b7276238b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaf01f45e7a429e9361eb176a3f7c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:36.892224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4e77-f796-455f-9bcf-d29b7276238b service glance] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:36.892506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4e77-f796-455f-9bcf-d29b7276238b service glance] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:36.892776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4e77-f796-455f-9bcf-d29b7276238b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:36.901345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4e77-f796-455f-9bcf-d29b7276238b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:36.902821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4e77-f796-455f-9bcf-d29b7276238b service glance] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:36.912839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 709/1399] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:37.323396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2b18e-9bf7-4dce-8124-f53c3249c6e5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:37.323787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2b18e-9bf7-4dce-8124-f53c3249c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:37.324177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee2b18e-9bf7-4dce-8124-f53c3249c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:37.367735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f082eea-264e-4289-a840-e1fc397b4211 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:37.368021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f082eea-264e-4289-a840-e1fc397b4211 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:37.368291 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f082eea-264e-4289-a840-e1fc397b4211 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:37.369641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 710/1400] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:18:37.375058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fee2b18e-9bf7-4dce-8124-f53c3249c6e5 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:37.375242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a341c-d900-4ac3-8a3b-5dd6739ac7d4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:37.375399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a341c-d900-4ac3-8a3b-5dd6739ac7d4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:37.375674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a341c-d900-4ac3-8a3b-5dd6739ac7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:37.376268 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fee2b18e-9bf7-4dce-8124-f53c3249c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:37.393358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a51a341c-d900-4ac3-8a3b-5dd6739ac7d4 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:37.394573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a51a341c-d900-4ac3-8a3b-5dd6739ac7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:37.402300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 711/1401] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:18:37.440297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 691/1402] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:18:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:37.447328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a341c-d900-4ac3-8a3b-5dd6739ac7d4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:37.462640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a341c-d900-4ac3-8a3b-5dd6739ac7d4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:37.468207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587539fc-298e-42ec-a33f-38d65d3bb230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:37.469072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587539fc-298e-42ec-a33f-38d65d3bb230 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:37.469203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587539fc-298e-42ec-a33f-38d65d3bb230 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:37.469482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587539fc-298e-42ec-a33f-38d65d3bb230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:37.478052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587539fc-298e-42ec-a33f-38d65d3bb230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:37.479725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587539fc-298e-42ec-a33f-38d65d3bb230 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:37.483377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b0c14-de21-4d73-9cda-2626b20f6dbe None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:37.483952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b0c14-de21-4d73-9cda-2626b20f6dbe None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:37.484261 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b0c14-de21-4d73-9cda-2626b20f6dbe None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:37.485611 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 692/1403] 10.222.0.32 () {54 vars in 942 bytes} [Tue Apr 12 00:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:18:37.489384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 712/1404] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:18:37.491353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7631a-0907-4c16-a838-d6000bb3df02 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:37.491638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7631a-0907-4c16-a838-d6000bb3df02 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:37.491910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7631a-0907-4c16-a838-d6000bb3df02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:37.540403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-18d7631a-0907-4c16-a838-d6000bb3df02 None None] MFA Rules not processed for user `dc91dcec14694193a8e60e32fc138b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:37.541593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-18d7631a-0907-4c16-a838-d6000bb3df02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:37.619714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 693/1405] 10.222.0.32 () {58 vars in 1039 bytes} [Tue Apr 12 00:18:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:18:37.628534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587539fc-298e-42ec-a33f-38d65d3bb230 service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:37.639888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587539fc-298e-42ec-a33f-38d65d3bb230 service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:37.645054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2482f5-d625-4c3e-b56b-94878c905573 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:37.645717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2482f5-d625-4c3e-b56b-94878c905573 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:37.646004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2482f5-d625-4c3e-b56b-94878c905573 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:37.646324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2482f5-d625-4c3e-b56b-94878c905573 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:37.656432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2482f5-d625-4c3e-b56b-94878c905573 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:37.658407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2482f5-d625-4c3e-b56b-94878c905573 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:37.667579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 713/1406] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:18:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:18:39.871634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8735c-c3d9-443c-b349-30489e4e8c3c None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:39.872174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8735c-c3d9-443c-b349-30489e4e8c3c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:39.872174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf8735c-c3d9-443c-b349-30489e4e8c3c None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:39.874782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 694/1407] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:18:39.880492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de2ff8-7b06-486e-a502-99ad2e757866 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:39.881156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de2ff8-7b06-486e-a502-99ad2e757866 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:39.881156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de2ff8-7b06-486e-a502-99ad2e757866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:39.908913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f9de2ff8-7b06-486e-a502-99ad2e757866 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:18:39.910139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f9de2ff8-7b06-486e-a502-99ad2e757866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:18:39.923294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 714/1408] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:18:39.965378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8735c-c3d9-443c-b349-30489e4e8c3c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:18:39.982403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf8735c-c3d9-443c-b349-30489e4e8c3c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:18:39.988665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36568712-4dcd-4863-af82-4192d0b71f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:18:39.989320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568712-4dcd-4863-af82-4192d0b71f11 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:18:39.989602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568712-4dcd-4863-af82-4192d0b71f11 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:18:39.989873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36568712-4dcd-4863-af82-4192d0b71f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:18:39.999199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568712-4dcd-4863-af82-4192d0b71f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:18:40.000782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36568712-4dcd-4863-af82-4192d0b71f11 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:18:40.010425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 695/1409] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:00.807325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56277-97d9-42bb-b39f-895b0e519d93 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:00.808333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56277-97d9-42bb-b39f-895b0e519d93 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:00.808333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc56277-97d9-42bb-b39f-895b0e519d93 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:00.809269 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 715/1410] 10.222.0.32 () {54 vars in 918 bytes} [Tue Apr 12 00:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:00.814423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e5231-0199-4562-ae29-01c4797bb12a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:00.814878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e5231-0199-4562-ae29-01c4797bb12a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:00.814980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e5231-0199-4562-ae29-01c4797bb12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:00.832893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-8d6e5231-0199-4562-ae29-01c4797bb12a None None] MFA Rules not processed for user `92588782f32a472193340aba2bff8d78`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:00.834074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8d6e5231-0199-4562-ae29-01c4797bb12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:00.843107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 696/1411] 10.222.0.32 () {58 vars in 1015 bytes} [Tue Apr 12 00:19:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:00.857168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e71d1-f116-4c51-ad76-93132ece55a4 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:00.857586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e71d1-f116-4c51-ad76-93132ece55a4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:00.857889 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e71d1-f116-4c51-ad76-93132ece55a4 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:00.859384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 716/1412] 10.222.0.32 () {54 vars in 918 bytes} [Tue Apr 12 00:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:00.863881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ec842-3336-402b-a127-7db0727edc70 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:00.864174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ec842-3336-402b-a127-7db0727edc70 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:00.864476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ec842-3336-402b-a127-7db0727edc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:00.881814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fa1ec842-3336-402b-a127-7db0727edc70 None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:00.883136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fa1ec842-3336-402b-a127-7db0727edc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:00.892812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 697/1413] 10.222.0.32 () {58 vars in 1015 bytes} [Tue Apr 12 00:19:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:03.637017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe178cf3-ca44-4989-aa8e-22264b56006a None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:03.637555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe178cf3-ca44-4989-aa8e-22264b56006a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:03.637555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe178cf3-ca44-4989-aa8e-22264b56006a None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:03.639569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:03.644951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a435cfd-d960-4292-8679-71222a0d8238 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:03.645361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a435cfd-d960-4292-8679-71222a0d8238 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:03.645501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a435cfd-d960-4292-8679-71222a0d8238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:03.663401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-1a435cfd-d960-4292-8679-71222a0d8238 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:03.664585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-1a435cfd-d960-4292-8679-71222a0d8238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:03.672262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:03.715418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe178cf3-ca44-4989-aa8e-22264b56006a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:03.729303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe178cf3-ca44-4989-aa8e-22264b56006a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:03.735134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0449d4-14f0-4aff-a33f-d25bd5c76b06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:03.735764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0449d4-14f0-4aff-a33f-d25bd5c76b06 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:03.736052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0449d4-14f0-4aff-a33f-d25bd5c76b06 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:03.736327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0449d4-14f0-4aff-a33f-d25bd5c76b06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:03.744256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0449d4-14f0-4aff-a33f-d25bd5c76b06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:03.745810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0449d4-14f0-4aff-a33f-d25bd5c76b06 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:03.755074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 718/1416] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:05.109141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30265fa9-37f9-4c95-a207-d284f1603be7 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:05.109709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30265fa9-37f9-4c95-a207-d284f1603be7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:05.109709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30265fa9-37f9-4c95-a207-d284f1603be7 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:05.111133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:05.116093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055ee20-52b0-4c74-a1d6-d73abb2aa2ed None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:05.116494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055ee20-52b0-4c74-a1d6-d73abb2aa2ed None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:05.116677 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055ee20-52b0-4c74-a1d6-d73abb2aa2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:05.133844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d055ee20-52b0-4c74-a1d6-d73abb2aa2ed None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:05.135039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d055ee20-52b0-4c74-a1d6-d73abb2aa2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:05.142613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:05.301008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30265fa9-37f9-4c95-a207-d284f1603be7 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:05.314907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30265fa9-37f9-4c95-a207-d284f1603be7 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:05.320113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a0b76-ff48-4146-830f-655b0f2647d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:05.320743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a0b76-ff48-4146-830f-655b0f2647d6 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:05.321033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a0b76-ff48-4146-830f-655b0f2647d6 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:05.321307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a0b76-ff48-4146-830f-655b0f2647d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:05.329554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a0b76-ff48-4146-830f-655b0f2647d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:05.331149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a0b76-ff48-4146-830f-655b0f2647d6 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:05.340256 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 700/1419] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:06.626343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f138f35-b808-434d-8ef7-f6133f2fbe54 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:06.626926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f138f35-b808-434d-8ef7-f6133f2fbe54 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:06.626926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f138f35-b808-434d-8ef7-f6133f2fbe54 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:06.628283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:06.633144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a45a12-4018-4095-9d86-bac30f70cce9 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:06.633575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a45a12-4018-4095-9d86-bac30f70cce9 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:06.633709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a45a12-4018-4095-9d86-bac30f70cce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:06.651165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-35a45a12-4018-4095-9d86-bac30f70cce9 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:06.652357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-35a45a12-4018-4095-9d86-bac30f70cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:06.660928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:06.809439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f138f35-b808-434d-8ef7-f6133f2fbe54 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:06.823289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f138f35-b808-434d-8ef7-f6133f2fbe54 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:06.829157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f10c93-12ec-49ae-8f84-31791c085e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:06.829781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f10c93-12ec-49ae-8f84-31791c085e69 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:06.830065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f10c93-12ec-49ae-8f84-31791c085e69 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:06.830378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f10c93-12ec-49ae-8f84-31791c085e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:06.838104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f10c93-12ec-49ae-8f84-31791c085e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:06.839701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f10c93-12ec-49ae-8f84-31791c085e69 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:06.849373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 721/1422] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:08.140698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d297ab-d0a2-485a-bab5-62f0a01e2bbb None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:08.141249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d297ab-d0a2-485a-bab5-62f0a01e2bbb None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:08.141249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d297ab-d0a2-485a-bab5-62f0a01e2bbb None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:08.142649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:08.147593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f83f7-b5b4-4d89-9c2d-c3a16cbfd70c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:08.148044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f83f7-b5b4-4d89-9c2d-c3a16cbfd70c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:08.148140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f83f7-b5b4-4d89-9c2d-c3a16cbfd70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:08.166438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-908f83f7-b5b4-4d89-9c2d-c3a16cbfd70c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:08.167633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-908f83f7-b5b4-4d89-9c2d-c3a16cbfd70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:08.175960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:08.325123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d297ab-d0a2-485a-bab5-62f0a01e2bbb None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:08.339538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d297ab-d0a2-485a-bab5-62f0a01e2bbb None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:08.345927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b94f4-3ee8-4f74-ac2e-219b1ae7d131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:08.346606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b94f4-3ee8-4f74-ac2e-219b1ae7d131 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:08.346891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b94f4-3ee8-4f74-ac2e-219b1ae7d131 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:08.347168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b94f4-3ee8-4f74-ac2e-219b1ae7d131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:08.355074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b94f4-3ee8-4f74-ac2e-219b1ae7d131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:08.356636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b94f4-3ee8-4f74-ac2e-219b1ae7d131 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:08.365828 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 703/1425] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:09.705210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff943c-5bc4-4fe9-96c5-4200c62765b9 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:09.705741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff943c-5bc4-4fe9-96c5-4200c62765b9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:09.705741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff943c-5bc4-4fe9-96c5-4200c62765b9 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:09.707162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:09.712912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677af88-e8c7-4cf8-b28d-da176b29dd60 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:09.713359 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677af88-e8c7-4cf8-b28d-da176b29dd60 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:09.713470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677af88-e8c7-4cf8-b28d-da176b29dd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:09.732008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b677af88-e8c7-4cf8-b28d-da176b29dd60 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:09.733213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b677af88-e8c7-4cf8-b28d-da176b29dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:09.740951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:09.891733 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff943c-5bc4-4fe9-96c5-4200c62765b9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:09.906308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff943c-5bc4-4fe9-96c5-4200c62765b9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:09.911811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1e734-a92d-47b6-9662-1fc19844de50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:09.912452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e734-a92d-47b6-9662-1fc19844de50 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:09.912733 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e734-a92d-47b6-9662-1fc19844de50 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:09.913008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1e734-a92d-47b6-9662-1fc19844de50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:09.921380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1e734-a92d-47b6-9662-1fc19844de50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:09.922989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1e734-a92d-47b6-9662-1fc19844de50 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:09.932602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 724/1428] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:11.199866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a473cf-8e58-47ce-a5f5-e103a5f0f8a2 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:11.200449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a473cf-8e58-47ce-a5f5-e103a5f0f8a2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:11.200449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a473cf-8e58-47ce-a5f5-e103a5f0f8a2 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:11.201905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:11.207418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5d79-124b-4df6-b267-091bfc074cdb None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:11.207816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5d79-124b-4df6-b267-091bfc074cdb None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:11.207972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5d79-124b-4df6-b267-091bfc074cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:11.225541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2dfa5d79-124b-4df6-b267-091bfc074cdb None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:11.226759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2dfa5d79-124b-4df6-b267-091bfc074cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:11.234932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:11.382106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a473cf-8e58-47ce-a5f5-e103a5f0f8a2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:11.395900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a473cf-8e58-47ce-a5f5-e103a5f0f8a2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:11.401059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc24ff-9b27-4346-9858-41c94afbc821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:11.401683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc24ff-9b27-4346-9858-41c94afbc821 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:11.401964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc24ff-9b27-4346-9858-41c94afbc821 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:11.402237 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc24ff-9b27-4346-9858-41c94afbc821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:11.410205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc24ff-9b27-4346-9858-41c94afbc821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:11.411771 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc24ff-9b27-4346-9858-41c94afbc821 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:11.421170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 706/1431] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:12.793790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a502-4938-4100-81b3-2fbaf649f268 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:12.794410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a502-4938-4100-81b3-2fbaf649f268 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:12.794410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612a502-4938-4100-81b3-2fbaf649f268 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:12.796322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:12.801422 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc5f9d-207c-45a9-a819-c4654db3a148 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:12.801873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc5f9d-207c-45a9-a819-c4654db3a148 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:12.801984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc5f9d-207c-45a9-a819-c4654db3a148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:12.822549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b7bc5f9d-207c-45a9-a819-c4654db3a148 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:12.824464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b7bc5f9d-207c-45a9-a819-c4654db3a148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:12.837546 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:12.985911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612a502-4938-4100-81b3-2fbaf649f268 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:13.001193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612a502-4938-4100-81b3-2fbaf649f268 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:13.006577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f8153-fb2a-493b-bf55-b619b58fe750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:13.007219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f8153-fb2a-493b-bf55-b619b58fe750 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:13.007502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f8153-fb2a-493b-bf55-b619b58fe750 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:13.007778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f8153-fb2a-493b-bf55-b619b58fe750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:13.016797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f8153-fb2a-493b-bf55-b619b58fe750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:13.018402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f8153-fb2a-493b-bf55-b619b58fe750 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:13.028491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 727/1434] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:14.291262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddaf42-4cbb-4ba2-9c5e-6a4ea564cd67 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:14.291849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddaf42-4cbb-4ba2-9c5e-6a4ea564cd67 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:14.291849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddaf42-4cbb-4ba2-9c5e-6a4ea564cd67 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:14.293175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:14.298545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca78fc-ebad-474b-b36d-4e97a5670368 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:14.298976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca78fc-ebad-474b-b36d-4e97a5670368 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:14.299101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca78fc-ebad-474b-b36d-4e97a5670368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:14.316791 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4eca78fc-ebad-474b-b36d-4e97a5670368 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:14.317974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4eca78fc-ebad-474b-b36d-4e97a5670368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:14.325645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:14.474816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddaf42-4cbb-4ba2-9c5e-6a4ea564cd67 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:14.488584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddaf42-4cbb-4ba2-9c5e-6a4ea564cd67 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:14.493795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9ced8-172e-4f28-ab2c-12576b5a424c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:14.494455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9ced8-172e-4f28-ab2c-12576b5a424c service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:14.494738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9ced8-172e-4f28-ab2c-12576b5a424c service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:14.495012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9ced8-172e-4f28-ab2c-12576b5a424c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:14.502715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9ced8-172e-4f28-ab2c-12576b5a424c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:14.504272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9ced8-172e-4f28-ab2c-12576b5a424c service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:14.513241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 709/1437] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:15.767692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645252a-5914-42bb-b59d-ae0b12d6b7af None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:15.768223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645252a-5914-42bb-b59d-ae0b12d6b7af None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:15.768319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645252a-5914-42bb-b59d-ae0b12d6b7af None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:15.769616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:15.774512 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef11e-ec67-4739-9630-556a26d6b154 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:15.774941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef11e-ec67-4739-9630-556a26d6b154 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:15.775056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ef11e-ec67-4739-9630-556a26d6b154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:15.793082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e73ef11e-ec67-4739-9630-556a26d6b154 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:15.794282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e73ef11e-ec67-4739-9630-556a26d6b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:15.801864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:15.948190 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645252a-5914-42bb-b59d-ae0b12d6b7af None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:15.962477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645252a-5914-42bb-b59d-ae0b12d6b7af None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:15.968348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eb2b3-aa1a-4c14-8757-e5728481027b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:15.968972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb2b3-aa1a-4c14-8757-e5728481027b service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:15.969248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb2b3-aa1a-4c14-8757-e5728481027b service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:15.969517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eb2b3-aa1a-4c14-8757-e5728481027b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:15.977243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eb2b3-aa1a-4c14-8757-e5728481027b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:15.978821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eb2b3-aa1a-4c14-8757-e5728481027b service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:15.987858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 730/1440] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:18.147178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b30f-7959-46d2-baaa-3b5e413d379e None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:18.147754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b30f-7959-46d2-baaa-3b5e413d379e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:18.147754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88b30f-7959-46d2-baaa-3b5e413d379e None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:18.149093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:18.154986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a55a-9d6c-4eba-a246-10812f8beddd None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:18.155435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a55a-9d6c-4eba-a246-10812f8beddd None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:18.155595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a55a-9d6c-4eba-a246-10812f8beddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:18.172858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b7b3a55a-9d6c-4eba-a246-10812f8beddd None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:18.174030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b7b3a55a-9d6c-4eba-a246-10812f8beddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:18.181588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:18.222933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b30f-7959-46d2-baaa-3b5e413d379e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:18.233361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88b30f-7959-46d2-baaa-3b5e413d379e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:18.236848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128ef2c-20d8-4dc6-b7f7-42df4a4a95e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:18.237476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128ef2c-20d8-4dc6-b7f7-42df4a4a95e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:18.237757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128ef2c-20d8-4dc6-b7f7-42df4a4a95e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:18.238030 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128ef2c-20d8-4dc6-b7f7-42df4a4a95e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:18.246625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128ef2c-20d8-4dc6-b7f7-42df4a4a95e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:18.248103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128ef2c-20d8-4dc6-b7f7-42df4a4a95e6 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:18.257154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 712/1443] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:20.693146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff6835-9c8f-422c-8f43-42d42672b5fd None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:20.693637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff6835-9c8f-422c-8f43-42d42672b5fd None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:20.693743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff6835-9c8f-422c-8f43-42d42672b5fd None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:20.695087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:20.700345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8d5bb-449d-4f6a-9232-5920f2640ff9 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:20.700793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8d5bb-449d-4f6a-9232-5920f2640ff9 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:20.700933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8d5bb-449d-4f6a-9232-5920f2640ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:20.718589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-79e8d5bb-449d-4f6a-9232-5920f2640ff9 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:20.719770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-79e8d5bb-449d-4f6a-9232-5920f2640ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:20.727378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:20.765499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff6835-9c8f-422c-8f43-42d42672b5fd None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:20.775827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aff6835-9c8f-422c-8f43-42d42672b5fd None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:20.779873 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f97c8-c64e-41b3-a4ec-322b0b3275e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:20.780513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f97c8-c64e-41b3-a4ec-322b0b3275e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:20.780793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f97c8-c64e-41b3-a4ec-322b0b3275e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:20.781065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f97c8-c64e-41b3-a4ec-322b0b3275e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:20.789896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f97c8-c64e-41b3-a4ec-322b0b3275e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:20.791342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f97c8-c64e-41b3-a4ec-322b0b3275e5 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:20.801024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 733/1446] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:23.372684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2cf67-24e2-438d-938b-8cd6da763a68 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:23.373288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2cf67-24e2-438d-938b-8cd6da763a68 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:23.373288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2cf67-24e2-438d-938b-8cd6da763a68 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:23.374729 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:23.380147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669ff2-b76c-4b01-b7ce-7dc44520142c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:23.380585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669ff2-b76c-4b01-b7ce-7dc44520142c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:23.380711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669ff2-b76c-4b01-b7ce-7dc44520142c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:23.398302 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-48669ff2-b76c-4b01-b7ce-7dc44520142c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:23.399495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-48669ff2-b76c-4b01-b7ce-7dc44520142c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:23.407981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:23.446797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2cf67-24e2-438d-938b-8cd6da763a68 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:23.448519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7ac2cf67-24e2-438d-938b-8cd6da763a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:23.461372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2cf67-24e2-438d-938b-8cd6da763a68 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:23.464790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a305ef6-eb7e-4eaf-8695-95c2cf2ebd87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:23.465430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a305ef6-eb7e-4eaf-8695-95c2cf2ebd87 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:23.465693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a305ef6-eb7e-4eaf-8695-95c2cf2ebd87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:23.465959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a305ef6-eb7e-4eaf-8695-95c2cf2ebd87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:23.475091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a305ef6-eb7e-4eaf-8695-95c2cf2ebd87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:23.476501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a305ef6-eb7e-4eaf-8695-95c2cf2ebd87 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:23.485509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 715/1449] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:25.928292 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbd91-7b6e-48eb-b29d-d5c4b8de33a8 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:25.928838 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbd91-7b6e-48eb-b29d-d5c4b8de33a8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:25.928838 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffbd91-7b6e-48eb-b29d-d5c4b8de33a8 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:25.930154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:19:25.935658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1dddf-cfd8-46ab-ad52-73a363242388 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:25.936093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1dddf-cfd8-46ab-ad52-73a363242388 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:25.936721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1dddf-cfd8-46ab-ad52-73a363242388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:25.954325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e3b1dddf-cfd8-46ab-ad52-73a363242388 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:25.955500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e3b1dddf-cfd8-46ab-ad52-73a363242388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:25.963089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:26.002440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbd91-7b6e-48eb-b29d-d5c4b8de33a8 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:26.012824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffbd91-7b6e-48eb-b29d-d5c4b8de33a8 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:26.016858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16318ed9-df04-46ec-8228-6835a068b705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:26.017486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318ed9-df04-46ec-8228-6835a068b705 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:26.017765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318ed9-df04-46ec-8228-6835a068b705 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:26.018039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16318ed9-df04-46ec-8228-6835a068b705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:26.026551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16318ed9-df04-46ec-8228-6835a068b705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:26.027956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16318ed9-df04-46ec-8228-6835a068b705 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:26.039717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 736/1452] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:28.385032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210874cf-31c3-4994-bf8e-b192e41db820 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:28.385601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210874cf-31c3-4994-bf8e-b192e41db820 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:28.385601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210874cf-31c3-4994-bf8e-b192e41db820 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:28.387003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:28.392799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40859bd-60a1-4f6c-a1ca-f23075bb3b2d None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:28.393236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40859bd-60a1-4f6c-a1ca-f23075bb3b2d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:28.393359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40859bd-60a1-4f6c-a1ca-f23075bb3b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:28.410937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b40859bd-60a1-4f6c-a1ca-f23075bb3b2d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:28.412127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b40859bd-60a1-4f6c-a1ca-f23075bb3b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:28.419882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:28.458908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210874cf-31c3-4994-bf8e-b192e41db820 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:28.469353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210874cf-31c3-4994-bf8e-b192e41db820 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:28.472826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912daf23-b275-4d1a-80c5-4ca5800a0bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:28.473455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912daf23-b275-4d1a-80c5-4ca5800a0bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:28.473741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912daf23-b275-4d1a-80c5-4ca5800a0bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:28.474019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912daf23-b275-4d1a-80c5-4ca5800a0bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:28.482639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912daf23-b275-4d1a-80c5-4ca5800a0bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:28.484545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912daf23-b275-4d1a-80c5-4ca5800a0bf4 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:28.493639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 718/1455] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:30.877241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad07f9-1863-4214-b35f-4277882f4d93 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:30.877794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad07f9-1863-4214-b35f-4277882f4d93 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:30.877794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad07f9-1863-4214-b35f-4277882f4d93 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:30.879187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:30.884435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4387b-26f9-41cc-96a3-58ec18d2e180 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:30.884829 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4387b-26f9-41cc-96a3-58ec18d2e180 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:30.885008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4387b-26f9-41cc-96a3-58ec18d2e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:30.902275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-65e4387b-26f9-41cc-96a3-58ec18d2e180 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:30.903442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-65e4387b-26f9-41cc-96a3-58ec18d2e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:30.911379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:30.950163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad07f9-1863-4214-b35f-4277882f4d93 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:30.960454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad07f9-1863-4214-b35f-4277882f4d93 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:30.964691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f94e4-5b90-4222-bda0-2b9f81c8745c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:30.965408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f94e4-5b90-4222-bda0-2b9f81c8745c service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:30.965687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f94e4-5b90-4222-bda0-2b9f81c8745c service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:30.965955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f94e4-5b90-4222-bda0-2b9f81c8745c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:30.974601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f94e4-5b90-4222-bda0-2b9f81c8745c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:30.975999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f94e4-5b90-4222-bda0-2b9f81c8745c service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:30.985861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 739/1458] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:33.337499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe81afe-bcf9-46e1-91d8-62f88c9062f1 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:33.338077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe81afe-bcf9-46e1-91d8-62f88c9062f1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:33.338077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe81afe-bcf9-46e1-91d8-62f88c9062f1 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:33.339441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:33.345518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12568f9c-749c-4088-8264-501c3226036c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:33.346021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12568f9c-749c-4088-8264-501c3226036c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:33.346114 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12568f9c-749c-4088-8264-501c3226036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:33.364181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-12568f9c-749c-4088-8264-501c3226036c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:33.365402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-12568f9c-749c-4088-8264-501c3226036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:33.373068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:33.411012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe81afe-bcf9-46e1-91d8-62f88c9062f1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:33.421830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe81afe-bcf9-46e1-91d8-62f88c9062f1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:33.425279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89a9a3-1f8c-4117-abab-b37e0027f398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:33.425903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89a9a3-1f8c-4117-abab-b37e0027f398 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:33.426182 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89a9a3-1f8c-4117-abab-b37e0027f398 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:33.426489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89a9a3-1f8c-4117-abab-b37e0027f398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:33.435035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89a9a3-1f8c-4117-abab-b37e0027f398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:33.436538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89a9a3-1f8c-4117-abab-b37e0027f398 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:33.445924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 721/1461] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:35.761118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c66c4a-6387-4a5d-abcd-3d4a0940c3ab None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:35.761675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c66c4a-6387-4a5d-abcd-3d4a0940c3ab None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:35.761783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c66c4a-6387-4a5d-abcd-3d4a0940c3ab None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:35.763143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:35.768305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcf767-68d1-4fdb-bb28-00f96388d168 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:35.768738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcf767-68d1-4fdb-bb28-00f96388d168 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:35.768847 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcf767-68d1-4fdb-bb28-00f96388d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:35.786861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c8fcf767-68d1-4fdb-bb28-00f96388d168 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:35.788050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c8fcf767-68d1-4fdb-bb28-00f96388d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:35.796391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:35.833829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c66c4a-6387-4a5d-abcd-3d4a0940c3ab None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:35.844763 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c66c4a-6387-4a5d-abcd-3d4a0940c3ab None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:35.848361 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2858a6-677d-4feb-9057-845769f9a263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:35.848994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2858a6-677d-4feb-9057-845769f9a263 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:35.849281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2858a6-677d-4feb-9057-845769f9a263 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:35.849553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2858a6-677d-4feb-9057-845769f9a263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:35.859015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2858a6-677d-4feb-9057-845769f9a263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:35.860451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2858a6-677d-4feb-9057-845769f9a263 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:35.869528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 742/1464] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:38.156886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d2603-de9a-49b6-852c-6f23f3d768c6 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:38.157711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d2603-de9a-49b6-852c-6f23f3d768c6 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:38.157711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d2603-de9a-49b6-852c-6f23f3d768c6 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:38.159094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:38.164259 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349aa55-f4bf-4e9d-98e1-8921096de509 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:38.164690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349aa55-f4bf-4e9d-98e1-8921096de509 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:38.164805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349aa55-f4bf-4e9d-98e1-8921096de509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:38.183837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2349aa55-f4bf-4e9d-98e1-8921096de509 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:38.185025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2349aa55-f4bf-4e9d-98e1-8921096de509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:38.192742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:38.230081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d2603-de9a-49b6-852c-6f23f3d768c6 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:38.240438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d2603-de9a-49b6-852c-6f23f3d768c6 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:38.243876 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831bf89-e84c-42ee-953e-5b9c869b07ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:38.244507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831bf89-e84c-42ee-953e-5b9c869b07ef service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:38.244793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831bf89-e84c-42ee-953e-5b9c869b07ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:38.245068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831bf89-e84c-42ee-953e-5b9c869b07ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:38.253659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831bf89-e84c-42ee-953e-5b9c869b07ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:38.255099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831bf89-e84c-42ee-953e-5b9c869b07ef service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:38.264613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 724/1467] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:40.554862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34d0d-d5d8-41bb-ac54-b2e1c0c45fcd None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:40.555426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34d0d-d5d8-41bb-ac54-b2e1c0c45fcd None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:40.555426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a34d0d-d5d8-41bb-ac54-b2e1c0c45fcd None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:40.556775 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:19:40.561916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f15e6-efae-4415-9b9c-72e00f27168c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:40.562338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f15e6-efae-4415-9b9c-72e00f27168c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:40.562522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f15e6-efae-4415-9b9c-72e00f27168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:40.580181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-905f15e6-efae-4415-9b9c-72e00f27168c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:19:40.581375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-905f15e6-efae-4415-9b9c-72e00f27168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:40.589046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:19:40.626348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34d0d-d5d8-41bb-ac54-b2e1c0c45fcd None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:40.636675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a34d0d-d5d8-41bb-ac54-b2e1c0c45fcd None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:40.640608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636be68-4f7b-4d56-b912-38b82cf7cf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:40.641231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636be68-4f7b-4d56-b912-38b82cf7cf71 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:40.641510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636be68-4f7b-4d56-b912-38b82cf7cf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:40.641782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636be68-4f7b-4d56-b912-38b82cf7cf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:40.650306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636be68-4f7b-4d56-b912-38b82cf7cf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:40.651730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636be68-4f7b-4d56-b912-38b82cf7cf71 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:40.661652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 745/1470] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:20:13.718449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bea92-20fa-45d7-b4b3-649b84922810 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:13.718979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bea92-20fa-45d7-b4b3-649b84922810 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:13.719096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bea92-20fa-45d7-b4b3-649b84922810 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:13.720388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 726/1471] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:20:13.725690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9a64b-8de2-443f-bdaf-31a94fd1b9b5 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:13.726122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9a64b-8de2-443f-bdaf-31a94fd1b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:13.726280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9a64b-8de2-443f-bdaf-31a94fd1b9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:13.743972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-81b9a64b-8de2-443f-bdaf-31a94fd1b9b5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:20:13.745160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-81b9a64b-8de2-443f-bdaf-31a94fd1b9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:20:13.753470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 746/1472] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:20:13.799899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be650741-1194-4e19-8dd8-cc0a4e4619c0 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:13.800395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be650741-1194-4e19-8dd8-cc0a4e4619c0 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:13.800687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be650741-1194-4e19-8dd8-cc0a4e4619c0 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:13.802037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 727/1473] 10.222.0.32 () {54 vars in 961 bytes} [Tue Apr 12 00:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:20:13.806846 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb279-7bad-4826-aa23-23cbbc0f00a3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:13.807131 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb279-7bad-4826-aa23-23cbbc0f00a3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:13.807405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb279-7bad-4826-aa23-23cbbc0f00a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:13.824499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-604fb279-7bad-4826-aa23-23cbbc0f00a3 None None] MFA Rules not processed for user `dfaf01f45e7a429e9361eb176a3f7c38`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:20:13.825674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-604fb279-7bad-4826-aa23-23cbbc0f00a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:20:13.831832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 747/1474] 10.222.0.32 () {58 vars in 1058 bytes} [Tue Apr 12 00:20:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:20:13.838968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be650741-1194-4e19-8dd8-cc0a4e4619c0 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:20:13.849843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be650741-1194-4e19-8dd8-cc0a4e4619c0 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:20:13.853296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4329cb-2fce-4ac5-a212-73834c32369d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaf01f45e7a429e9361eb176a3f7c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:20:13.853916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4329cb-2fce-4ac5-a212-73834c32369d service glance] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:13.854205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4329cb-2fce-4ac5-a212-73834c32369d service glance] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:13.854517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4329cb-2fce-4ac5-a212-73834c32369d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:13.863732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4329cb-2fce-4ac5-a212-73834c32369d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:20:13.865143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4329cb-2fce-4ac5-a212-73834c32369d service glance] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:20:13.874422 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 728/1475] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:20:16.266952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af6fc-455f-4cad-b58a-3e0fff40e6cd None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:16.267535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af6fc-455f-4cad-b58a-3e0fff40e6cd None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:16.267535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af6fc-455f-4cad-b58a-3e0fff40e6cd None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:16.268870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 748/1476] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:20:16.274054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec32508-98d8-4e44-ab0a-6b45caeb84c7 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:16.274539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec32508-98d8-4e44-ab0a-6b45caeb84c7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:16.274654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec32508-98d8-4e44-ab0a-6b45caeb84c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:16.292323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-1ec32508-98d8-4e44-ab0a-6b45caeb84c7 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:20:16.293486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-1ec32508-98d8-4e44-ab0a-6b45caeb84c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:20:16.301987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 729/1477] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:20:16.325060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af6fc-455f-4cad-b58a-3e0fff40e6cd None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:20:16.337184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af6fc-455f-4cad-b58a-3e0fff40e6cd None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:20:16.342098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1724e-cbdf-45ea-857b-20bdabb1a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:20:16.342784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1724e-cbdf-45ea-857b-20bdabb1a63d admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:16.343073 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1724e-cbdf-45ea-857b-20bdabb1a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:16.343354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1724e-cbdf-45ea-857b-20bdabb1a63d admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:16.344078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1724e-cbdf-45ea-857b-20bdabb1a63d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:20:16.345776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING py.warnings [None req-05d1724e-cbdf-45ea-857b-20bdabb1a63d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:20:16.345776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: warnings.warn(msg) Apr 12 00:20:16.345776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: Apr 12 00:20:16.346955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1724e-cbdf-45ea-857b-20bdabb1a63d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:20:16.366324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 749/1478] 10.222.0.32 () {56 vars in 1108 bytes} [Tue Apr 12 00:20:16 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:20:18.661597 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300eba5-82f0-48c0-936f-100cfb4b3649 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:18.662151 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300eba5-82f0-48c0-936f-100cfb4b3649 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:18.662151 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300eba5-82f0-48c0-936f-100cfb4b3649 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:18.663571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 730/1479] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:20:18.668921 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f89350-d5e4-4e66-88c3-e015def5d1fb None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:18.669308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f89350-d5e4-4e66-88c3-e015def5d1fb None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:18.670094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f89350-d5e4-4e66-88c3-e015def5d1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:18.687875 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a3f89350-d5e4-4e66-88c3-e015def5d1fb None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:20:18.689040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a3f89350-d5e4-4e66-88c3-e015def5d1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:20:18.696696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 750/1480] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:20:18.737493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300eba5-82f0-48c0-936f-100cfb4b3649 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:20:18.751831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300eba5-82f0-48c0-936f-100cfb4b3649 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:20:18.757118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b5fb4-0b7d-49c6-8698-2f8f782f2327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:20:18.757742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b5fb4-0b7d-49c6-8698-2f8f782f2327 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:18.758027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b5fb4-0b7d-49c6-8698-2f8f782f2327 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:18.758335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b5fb4-0b7d-49c6-8698-2f8f782f2327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:18.766067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b5fb4-0b7d-49c6-8698-2f8f782f2327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:20:18.767670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b5fb4-0b7d-49c6-8698-2f8f782f2327 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:20:18.776692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 731/1481] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:20:21.221562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f51ab-f0c0-4b5f-b5d8-411da6a7dee6 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:21.222163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f51ab-f0c0-4b5f-b5d8-411da6a7dee6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:21.222163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f51ab-f0c0-4b5f-b5d8-411da6a7dee6 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:21.223547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 751/1482] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:20:21.228784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea3ced-3a61-4f50-be51-967019004b5b None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:21.229218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea3ced-3a61-4f50-be51-967019004b5b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:21.229357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea3ced-3a61-4f50-be51-967019004b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:21.246643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5aea3ced-3a61-4f50-be51-967019004b5b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:20:21.247827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5aea3ced-3a61-4f50-be51-967019004b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:20:21.256002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 732/1483] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:20:21.291730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f51ab-f0c0-4b5f-b5d8-411da6a7dee6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:20:21.302076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f51ab-f0c0-4b5f-b5d8-411da6a7dee6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:20:21.305526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787f331-7e23-48c7-a6d3-ca4f4d18779c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:20:21.306152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787f331-7e23-48c7-a6d3-ca4f4d18779c service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:21.306477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787f331-7e23-48c7-a6d3-ca4f4d18779c service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:21.306764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787f331-7e23-48c7-a6d3-ca4f4d18779c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:21.315836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787f331-7e23-48c7-a6d3-ca4f4d18779c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:20:21.317256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787f331-7e23-48c7-a6d3-ca4f4d18779c service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:20:21.326409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 752/1484] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:20:23.659174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adf6d4-13ea-4e24-adce-e5b70870d590 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:23.659731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adf6d4-13ea-4e24-adce-e5b70870d590 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:23.659731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adf6d4-13ea-4e24-adce-e5b70870d590 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:23.661100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 733/1485] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:20:23.666357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c9a3-96ce-438a-8c1b-d69b3c06a8ec None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:23.666807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c9a3-96ce-438a-8c1b-d69b3c06a8ec None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:23.666958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3c9a3-96ce-438a-8c1b-d69b3c06a8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:23.684016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d6e3c9a3-96ce-438a-8c1b-d69b3c06a8ec None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:20:23.685198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d6e3c9a3-96ce-438a-8c1b-d69b3c06a8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:20:23.693405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 753/1486] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:20:23.730922 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adf6d4-13ea-4e24-adce-e5b70870d590 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:20:23.741227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adf6d4-13ea-4e24-adce-e5b70870d590 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:20:23.744709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda44b39-4774-4590-bbe3-55f320e47aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:20:23.745340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda44b39-4774-4590-bbe3-55f320e47aff service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:23.745622 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda44b39-4774-4590-bbe3-55f320e47aff service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:23.745896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda44b39-4774-4590-bbe3-55f320e47aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:23.754986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda44b39-4774-4590-bbe3-55f320e47aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:20:23.756399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda44b39-4774-4590-bbe3-55f320e47aff service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:20:23.766033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 734/1487] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:20:26.136681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64d9a8-59da-4488-a463-373cf38f5631 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:26.137248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64d9a8-59da-4488-a463-373cf38f5631 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:26.137248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64d9a8-59da-4488-a463-373cf38f5631 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:26.138634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 754/1488] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:20:26.144515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d839aa-0b57-4504-b567-1c340f466841 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:26.144929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d839aa-0b57-4504-b567-1c340f466841 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:26.145098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d839aa-0b57-4504-b567-1c340f466841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:26.162703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c7d839aa-0b57-4504-b567-1c340f466841 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:20:26.163874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c7d839aa-0b57-4504-b567-1c340f466841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:20:26.171903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 735/1489] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:20:26.211893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64d9a8-59da-4488-a463-373cf38f5631 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:20:26.223178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64d9a8-59da-4488-a463-373cf38f5631 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:20:26.226683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2501e8-4d7a-4f33-b793-cc182ecb624c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:20:26.227315 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2501e8-4d7a-4f33-b793-cc182ecb624c service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:26.227600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2501e8-4d7a-4f33-b793-cc182ecb624c service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:26.227878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2501e8-4d7a-4f33-b793-cc182ecb624c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:26.236621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2501e8-4d7a-4f33-b793-cc182ecb624c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:20:26.238058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2501e8-4d7a-4f33-b793-cc182ecb624c service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:20:26.248287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 755/1490] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:20:28.714795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f1fc-1f57-4240-abb2-05e4425818b0 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:28.715300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f1fc-1f57-4240-abb2-05e4425818b0 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:28.715419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90f1fc-1f57-4240-abb2-05e4425818b0 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:28.716724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 736/1491] 10.222.0.32 () {54 vars in 926 bytes} [Tue Apr 12 00:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:20:28.722487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7043e-7414-48d6-b97f-387ce8ce2007 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:28.722905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7043e-7414-48d6-b97f-387ce8ce2007 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:28.723036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7043e-7414-48d6-b97f-387ce8ce2007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:28.740129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-8dd7043e-7414-48d6-b97f-387ce8ce2007 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:20:28.741314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8dd7043e-7414-48d6-b97f-387ce8ce2007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:20:28.749675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 756/1492] 10.222.0.32 () {58 vars in 1023 bytes} [Tue Apr 12 00:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:20:28.788440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90f1fc-1f57-4240-abb2-05e4425818b0 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:20:28.798688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90f1fc-1f57-4240-abb2-05e4425818b0 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:20:28.802085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53bdad-360b-401a-a498-8b1b52af215c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:20:28.802742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53bdad-360b-401a-a498-8b1b52af215c service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:20:28.803021 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53bdad-360b-401a-a498-8b1b52af215c service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:20:28.803294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53bdad-360b-401a-a498-8b1b52af215c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:20:28.812129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53bdad-360b-401a-a498-8b1b52af215c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:20:28.813523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53bdad-360b-401a-a498-8b1b52af215c service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:20:28.822507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 737/1493] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:21:57.416019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcee2d-90d3-4607-9e09-8d824e457dd4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.416614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcee2d-90d3-4607-9e09-8d824e457dd4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.416614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcee2d-90d3-4607-9e09-8d824e457dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.434549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-09fcee2d-90d3-4607-9e09-8d824e457dd4 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:21:57.435732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-09fcee2d-90d3-4607-9e09-8d824e457dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:21:57.443350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 757/1494] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:21:57.451380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157e99-d229-47ee-89c5-f5c681070dde None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.451851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157e99-d229-47ee-89c5-f5c681070dde None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.451959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3157e99-d229-47ee-89c5-f5c681070dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.469401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c3157e99-d229-47ee-89c5-f5c681070dde None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:21:57.470601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c3157e99-d229-47ee-89c5-f5c681070dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:21:57.478068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 738/1495] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:21:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:21:57.483106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcee2d-90d3-4607-9e09-8d824e457dd4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:57.492412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcee2d-90d3-4607-9e09-8d824e457dd4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:57.496954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:57.497597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.497880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.498156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.498909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:21:57.499214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:57.500205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING py.warnings [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:21:57.500205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: warnings.warn(msg) Apr 12 00:21:57.500205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: Apr 12 00:21:57.501082 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:57.511923 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 758/1496] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:21:57.519701 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3157e99-d229-47ee-89c5-f5c681070dde None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:57.529034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3157e99-d229-47ee-89c5-f5c681070dde None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:57.537125 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b94b62-883f-4e2f-8be5-a24476f67021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:57.537769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94b62-883f-4e2f-8be5-a24476f67021 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.538052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94b62-883f-4e2f-8be5-a24476f67021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.538361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b94b62-883f-4e2f-8be5-a24476f67021 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.539041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b94b62-883f-4e2f-8be5-a24476f67021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:57.540729 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING py.warnings [None req-c5b94b62-883f-4e2f-8be5-a24476f67021 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:21:57.540729 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: warnings.warn(msg) Apr 12 00:21:57.540729 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: Apr 12 00:21:57.541904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b94b62-883f-4e2f-8be5-a24476f67021 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:57.576787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 739/1497] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:21:57 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:21:57.580849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:57.591135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f3fe9-bc30-4ec7-a478-aa85e86182ed admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:57.643760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d480d-84b9-4b07-b16b-7b8e3b6f6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:57.644430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d480d-84b9-4b07-b16b-7b8e3b6f6377 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.644717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d480d-84b9-4b07-b16b-7b8e3b6f6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.644999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d480d-84b9-4b07-b16b-7b8e3b6f6377 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.645703 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d480d-84b9-4b07-b16b-7b8e3b6f6377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:57.646757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING py.warnings [None req-f54d480d-84b9-4b07-b16b-7b8e3b6f6377 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:21:57.646757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: warnings.warn(msg) Apr 12 00:21:57.646757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: Apr 12 00:21:57.648068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d480d-84b9-4b07-b16b-7b8e3b6f6377 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:57.669587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 759/1498] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:21:57 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:21:57.673602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b94b62-883f-4e2f-8be5-a24476f67021 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:57.684289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b94b62-883f-4e2f-8be5-a24476f67021 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:57.688840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966005bf-3834-4c91-b874-73d1e26893d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:57.689493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966005bf-3834-4c91-b874-73d1e26893d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.689776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966005bf-3834-4c91-b874-73d1e26893d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.690049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966005bf-3834-4c91-b874-73d1e26893d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.690803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966005bf-3834-4c91-b874-73d1e26893d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:57.691811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING py.warnings [None req-966005bf-3834-4c91-b874-73d1e26893d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:21:57.691811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: warnings.warn(msg) Apr 12 00:21:57.691811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: Apr 12 00:21:57.692687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966005bf-3834-4c91-b874-73d1e26893d2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:57.705574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 740/1499] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:21:57.709562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d480d-84b9-4b07-b16b-7b8e3b6f6377 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:57.719802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d480d-84b9-4b07-b16b-7b8e3b6f6377 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:57.724198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14303ba-2870-456c-be31-966b65028daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:57.724909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14303ba-2870-456c-be31-966b65028daf admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.725182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14303ba-2870-456c-be31-966b65028daf admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.725454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14303ba-2870-456c-be31-966b65028daf admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.726182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14303ba-2870-456c-be31-966b65028daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:57.727176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING py.warnings [None req-a14303ba-2870-456c-be31-966b65028daf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:21:57.727176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: warnings.warn(msg) Apr 12 00:21:57.727176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: Apr 12 00:21:57.728047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14303ba-2870-456c-be31-966b65028daf admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:57.740715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 760/1500] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:21:57.744473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966005bf-3834-4c91-b874-73d1e26893d2 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:57.753816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966005bf-3834-4c91-b874-73d1e26893d2 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:57.758314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437304-9578-4586-9be8-6ecb61819be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:57.759169 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437304-9578-4586-9be8-6ecb61819be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.759449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437304-9578-4586-9be8-6ecb61819be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.759721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32437304-9578-4586-9be8-6ecb61819be8 admin admin] PATH_INFO: `/v3/projects/9573f7b3eb2349f98d21834ad4db9b6d/users/c61d63ad25914752be45ab491acbe930/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.775113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32437304-9578-4586-9be8-6ecb61819be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9573f7b3eb2349f98d21834ad4db9b6d, user_id=c61d63ad25914752be45ab491acbe930, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:57.776128 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING py.warnings [None req-32437304-9578-4586-9be8-6ecb61819be8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:21:57.776128 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: warnings.warn(msg) Apr 12 00:21:57.776128 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: Apr 12 00:21:57.778773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32437304-9578-4586-9be8-6ecb61819be8 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:57.791716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 741/1501] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:21:57 2022] PUT /identity/v3/projects/9573f7b3eb2349f98d21834ad4db9b6d/users/c61d63ad25914752be45ab491acbe930/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:21:57.802740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6758c3-3aba-4eb3-81ef-8813ae80dae1 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.803035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6758c3-3aba-4eb3-81ef-8813ae80dae1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.803316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6758c3-3aba-4eb3-81ef-8813ae80dae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.828598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5f6758c3-3aba-4eb3-81ef-8813ae80dae1 None None] MFA Rules not processed for user `c61d63ad25914752be45ab491acbe930`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:21:57.829791 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5f6758c3-3aba-4eb3-81ef-8813ae80dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:21:57.890699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 761/1502] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:21:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:21:57.901615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437304-9578-4586-9be8-6ecb61819be8 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:57.969067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32437304-9578-4586-9be8-6ecb61819be8 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:57.974593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e2645-34a1-410a-a2e9-0cccb114bb59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:57.975237 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e2645-34a1-410a-a2e9-0cccb114bb59 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:57.975521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e2645-34a1-410a-a2e9-0cccb114bb59 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:57.975797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e2645-34a1-410a-a2e9-0cccb114bb59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:57.983372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e2645-34a1-410a-a2e9-0cccb114bb59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:57.984944 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e2645-34a1-410a-a2e9-0cccb114bb59 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:57.993641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 742/1503] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:21:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:21:58.063663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a18a97-de9f-4923-90bf-b14da56af01b None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:58.063959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a18a97-de9f-4923-90bf-b14da56af01b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:58.064270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a18a97-de9f-4923-90bf-b14da56af01b None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:58.065546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 762/1504] 10.222.0.32 () {52 vars in 829 bytes} [Tue Apr 12 00:21:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:21:58.069004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e2645-34a1-410a-a2e9-0cccb114bb59 service nova] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:58.127380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e2645-34a1-410a-a2e9-0cccb114bb59 service nova] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:58.131860 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:58.132716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:58.132994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:58.133267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] PATH_INFO: `/v3/users/c61d63ad25914752be45ab491acbe930` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:58.134458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61d63ad25914752be45ab491acbe930)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:58.135464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING py.warnings [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:21:58.135464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: warnings.warn(msg) Apr 12 00:21:58.135464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: Apr 12 00:21:58.136648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:58.197792 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61d63ad25914752be45ab491acbe930'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.210211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61d63ad25914752be45ab491acbe930'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.218809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61d63ad25914752be45ab491acbe930'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.219690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61d63ad25914752be45ab491acbe930'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.220266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61d63ad25914752be45ab491acbe930'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.242641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 743/1505] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:21:58 2022] DELETE /identity/v3/users/c61d63ad25914752be45ab491acbe930 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:21:58.247642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bee0f7-e81a-4838-be18-2d9a1de75866 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:58.247936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bee0f7-e81a-4838-be18-2d9a1de75866 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:58.248215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bee0f7-e81a-4838-be18-2d9a1de75866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:58.267074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-32bee0f7-e81a-4838-be18-2d9a1de75866 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:21:58.268272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-32bee0f7-e81a-4838-be18-2d9a1de75866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:21:58.323449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 763/1506] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:21:58.333423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:58.334942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:21:58.394321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9661899-3869-4baf-9185-4a07eb7793a0 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:58.397885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bbaa8-2d44-4bf8-96b9-e4a1923a5c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:58.398563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bbaa8-2d44-4bf8-96b9-e4a1923a5c5e service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:58.398851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bbaa8-2d44-4bf8-96b9-e4a1923a5c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:58.399132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bbaa8-2d44-4bf8-96b9-e4a1923a5c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:58.408348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bbaa8-2d44-4bf8-96b9-e4a1923a5c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:58.409781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bbaa8-2d44-4bf8-96b9-e4a1923a5c5e service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:58.419730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 744/1507] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:21:58.772711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bee0f7-e81a-4838-be18-2d9a1de75866 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:21:58.774131 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-32bee0f7-e81a-4838-be18-2d9a1de75866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:21:58.786828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bee0f7-e81a-4838-be18-2d9a1de75866 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:21:58.791432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:21:58.792274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:21:58.792558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:21:58.792836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] PATH_INFO: `/v3/projects/9573f7b3eb2349f98d21834ad4db9b6d` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:21:58.796652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9573f7b3eb2349f98d21834ad4db9b6d)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:21:58.796652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING py.warnings [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:21:58.796652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: warnings.warn(msg) Apr 12 00:21:58.796652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: Apr 12 00:21:58.797163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:21:58.859792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9573f7b3eb2349f98d21834ad4db9b6d', 'request_id': 'req-f0ee6477-1dbb-455a-8f33-9863babe4adb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.869601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9573f7b3eb2349f98d21834ad4db9b6d', 'request_id': 'req-f0ee6477-1dbb-455a-8f33-9863babe4adb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.882781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9573f7b3eb2349f98d21834ad4db9b6d', 'request_id': 'req-f0ee6477-1dbb-455a-8f33-9863babe4adb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.893109 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] The token cache is being invalidate because project 9573f7b3eb2349f98d21834ad4db9b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:21:58.893396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.894025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f0ee6477-1dbb-455a-8f33-9863babe4adb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:21:58.895760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 764/1508] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:21:58 2022] DELETE /identity/v3/projects/9573f7b3eb2349f98d21834ad4db9b6d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:23:36.204432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eabfbc-794e-4ed7-9a0a-b5c1e7e0e889 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:36.205030 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eabfbc-794e-4ed7-9a0a-b5c1e7e0e889 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:36.205030 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eabfbc-794e-4ed7-9a0a-b5c1e7e0e889 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:36.206410 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 745/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:23:36.211041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f99fb-a013-4686-8d3b-e5cd19c6f242 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:36.211498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f99fb-a013-4686-8d3b-e5cd19c6f242 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:36.211605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f99fb-a013-4686-8d3b-e5cd19c6f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:36.229546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a98f99fb-a013-4686-8d3b-e5cd19c6f242 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:23:36.230760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a98f99fb-a013-4686-8d3b-e5cd19c6f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:36.285557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 765/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:23:36.436408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eabfbc-794e-4ed7-9a0a-b5c1e7e0e889 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:23:36.438037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-54eabfbc-794e-4ed7-9a0a-b5c1e7e0e889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:36.508047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eabfbc-794e-4ed7-9a0a-b5c1e7e0e889 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:23:36.513849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff962d-0f45-4e6e-8900-8c55cf05ebb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:23:36.514511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff962d-0f45-4e6e-8900-8c55cf05ebb8 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:36.514794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff962d-0f45-4e6e-8900-8c55cf05ebb8 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:36.515069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff962d-0f45-4e6e-8900-8c55cf05ebb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:36.522877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff962d-0f45-4e6e-8900-8c55cf05ebb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:23:36.524447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff962d-0f45-4e6e-8900-8c55cf05ebb8 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:23:36.533657 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 746/1511] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:23:37.304847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d4d26-f718-45d9-99de-9c97628d8f6a None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:37.305414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d4d26-f718-45d9-99de-9c97628d8f6a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:37.305414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d4d26-f718-45d9-99de-9c97628d8f6a None None] PATH_INFO: `/v3` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:37.306837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 766/1512] 10.222.0.52 () {54 vars in 925 bytes} [Tue Apr 12 00:23:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:23:37.312855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a749c7d-0ec4-4766-912e-51442b1b736e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:37.313277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a749c7d-0ec4-4766-912e-51442b1b736e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:37.313424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a749c7d-0ec4-4766-912e-51442b1b736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:37.331816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0a749c7d-0ec4-4766-912e-51442b1b736e None None] MFA Rules not processed for user `92588782f32a472193340aba2bff8d78`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:23:37.333022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0a749c7d-0ec4-4766-912e-51442b1b736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:37.392637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 747/1513] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Apr 12 00:23:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:23:37.816103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a7b2-66f4-4a4d-a621-a4f67745b650 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:37.816387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a7b2-66f4-4a4d-a621-a4f67745b650 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:37.816663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a7b2-66f4-4a4d-a621-a4f67745b650 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:37.818130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:23:37.822986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac3871-3b19-49d8-bbda-d0b76a63b0a5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:37.823279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac3871-3b19-49d8-bbda-d0b76a63b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:37.823559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac3871-3b19-49d8-bbda-d0b76a63b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:37.843720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-feac3871-3b19-49d8-bbda-d0b76a63b0a5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:23:37.844946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-feac3871-3b19-49d8-bbda-d0b76a63b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:37.852685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:23:38.002692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834a7b2-66f4-4a4d-a621-a4f67745b650 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:23:38.017271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834a7b2-66f4-4a4d-a621-a4f67745b650 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:23:38.022609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10569389-9767-4ab2-801f-c76accaee8ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:23:38.023242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569389-9767-4ab2-801f-c76accaee8ca service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:38.023526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569389-9767-4ab2-801f-c76accaee8ca service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:38.023801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10569389-9767-4ab2-801f-c76accaee8ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:38.032452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10569389-9767-4ab2-801f-c76accaee8ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:23:38.034020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10569389-9767-4ab2-801f-c76accaee8ca service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:23:38.043617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 768/1516] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:23:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:23:46.686416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91306f-a629-4698-b291-99f1d2eca2d1 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:46.686905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91306f-a629-4698-b291-99f1d2eca2d1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:46.687002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91306f-a629-4698-b291-99f1d2eca2d1 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:46.688325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 749/1517] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 00:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:23:46.693158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510438f-239e-470f-a03e-b43a17eabf70 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:46.693604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510438f-239e-470f-a03e-b43a17eabf70 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:46.693734 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510438f-239e-470f-a03e-b43a17eabf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:46.710947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1510438f-239e-470f-a03e-b43a17eabf70 None None] MFA Rules not processed for user `92588782f32a472193340aba2bff8d78`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:23:46.712107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1510438f-239e-470f-a03e-b43a17eabf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:46.720341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 769/1518] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 00:23:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:23:46.727645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91306f-a629-4698-b291-99f1d2eca2d1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:23:46.740958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91306f-a629-4698-b291-99f1d2eca2d1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:23:46.746431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b5a93-ea25-4a7a-8170-a11c1717cee3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92588782f32a472193340aba2bff8d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:23:46.747071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5a93-ea25-4a7a-8170-a11c1717cee3 service placement] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:46.747351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5a93-ea25-4a7a-8170-a11c1717cee3 service placement] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:46.747623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b5a93-ea25-4a7a-8170-a11c1717cee3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:46.755482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b5a93-ea25-4a7a-8170-a11c1717cee3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:23:46.757039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b5a93-ea25-4a7a-8170-a11c1717cee3 service placement] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:23:46.766306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 750/1519] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:23:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:23:49.698476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52156b-cdab-441d-bdc3-64581d03c01c None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:49.698996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52156b-cdab-441d-bdc3-64581d03c01c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:49.699104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52156b-cdab-441d-bdc3-64581d03c01c None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:49.700398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 770/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:23:49.705258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fbde0-0431-4c26-8b8b-f8487e25e263 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:49.705697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fbde0-0431-4c26-8b8b-f8487e25e263 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:49.705812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fbde0-0431-4c26-8b8b-f8487e25e263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:49.723161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ef7fbde0-0431-4c26-8b8b-f8487e25e263 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:23:49.724333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ef7fbde0-0431-4c26-8b8b-f8487e25e263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:49.732428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 751/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:23:49.880077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52156b-cdab-441d-bdc3-64581d03c01c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:23:49.894727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52156b-cdab-441d-bdc3-64581d03c01c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:23:49.900108 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a6290-9059-4f75-ac0c-d0c5fb812845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:23:49.900738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6290-9059-4f75-ac0c-d0c5fb812845 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:49.901021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6290-9059-4f75-ac0c-d0c5fb812845 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:49.901297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a6290-9059-4f75-ac0c-d0c5fb812845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:49.909892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a6290-9059-4f75-ac0c-d0c5fb812845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:23:49.911498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a6290-9059-4f75-ac0c-d0c5fb812845 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:23:49.920625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 771/1522] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:23:51.171053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dae823-fce1-4e1c-a017-19b1cf60c3d0 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:51.171632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dae823-fce1-4e1c-a017-19b1cf60c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:51.171632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dae823-fce1-4e1c-a017-19b1cf60c3d0 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:51.173078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 752/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Apr 12 00:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:23:51.177969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979d55e-2122-4eaa-83bc-1fd12800a2c8 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:51.178391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979d55e-2122-4eaa-83bc-1fd12800a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:51.178553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979d55e-2122-4eaa-83bc-1fd12800a2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:51.196725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4979d55e-2122-4eaa-83bc-1fd12800a2c8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:23:51.197989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4979d55e-2122-4eaa-83bc-1fd12800a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:51.205545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 772/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Apr 12 00:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:23:51.355987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dae823-fce1-4e1c-a017-19b1cf60c3d0 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:23:51.370496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dae823-fce1-4e1c-a017-19b1cf60c3d0 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:23:51.375741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b03d-17d0-4160-9dad-d3da465e916b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:23:51.376389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b03d-17d0-4160-9dad-d3da465e916b service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:51.376667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b03d-17d0-4160-9dad-d3da465e916b service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:51.376961 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b03d-17d0-4160-9dad-d3da465e916b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:51.384661 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b03d-17d0-4160-9dad-d3da465e916b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:23:51.386840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b03d-17d0-4160-9dad-d3da465e916b service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:23:51.395809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 753/1525] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:23:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:23:55.407952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b5975-b993-443e-aff5-a5bb345d6448 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:55.408497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b5975-b993-443e-aff5-a5bb345d6448 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:55.408596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b5975-b993-443e-aff5-a5bb345d6448 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:55.409895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 773/1526] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:23:55.415330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0bce5-3971-410a-b0a1-8e8285196ced None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:55.415741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0bce5-3971-410a-b0a1-8e8285196ced None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:55.416423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0bce5-3971-410a-b0a1-8e8285196ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:55.434215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d4a0bce5-3971-410a-b0a1-8e8285196ced None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:23:55.435423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d4a0bce5-3971-410a-b0a1-8e8285196ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:55.443010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 754/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:23:55.478915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b5975-b993-443e-aff5-a5bb345d6448 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:23:55.480602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5e9b5975-b993-443e-aff5-a5bb345d6448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:55.534201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b5975-b993-443e-aff5-a5bb345d6448 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:23:55.537634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04176cf-25bf-4f5d-84d3-f4ee350d034f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:23:55.538281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04176cf-25bf-4f5d-84d3-f4ee350d034f service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:55.538590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04176cf-25bf-4f5d-84d3-f4ee350d034f service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:55.538847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04176cf-25bf-4f5d-84d3-f4ee350d034f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:55.547918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04176cf-25bf-4f5d-84d3-f4ee350d034f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:23:55.549662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04176cf-25bf-4f5d-84d3-f4ee350d034f service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:23:55.559209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 774/1528] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:23:57.861385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e9f9-e938-46e5-9e53-56ae1f6059cf None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:57.861937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e9f9-e938-46e5-9e53-56ae1f6059cf None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:57.862053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e9f9-e938-46e5-9e53-56ae1f6059cf None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:57.863670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 755/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:23:57.868893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f453e8-42ae-4094-86be-023afc4ef2ac None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:57.869322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f453e8-42ae-4094-86be-023afc4ef2ac None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:57.869438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f453e8-42ae-4094-86be-023afc4ef2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:57.887671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-04f453e8-42ae-4094-86be-023afc4ef2ac None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:23:57.888863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-04f453e8-42ae-4094-86be-023afc4ef2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:57.896749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 775/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:23:57.933943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158e9f9-e938-46e5-9e53-56ae1f6059cf None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:23:57.935652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2158e9f9-e938-46e5-9e53-56ae1f6059cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:23:57.948393 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158e9f9-e938-46e5-9e53-56ae1f6059cf None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:23:57.952090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e3065-bc36-4c18-890e-34b556d03ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:23:57.952803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e3065-bc36-4c18-890e-34b556d03ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:23:57.953109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e3065-bc36-4c18-890e-34b556d03ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:23:57.953406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e3065-bc36-4c18-890e-34b556d03ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:23:57.962070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e3065-bc36-4c18-890e-34b556d03ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:23:57.963526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e3065-bc36-4c18-890e-34b556d03ba4 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:23:57.972975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 756/1531] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:24:01.928022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339ac5d-78c7-4dde-8d8a-524c7d70a6a5 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:24:01.928557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339ac5d-78c7-4dde-8d8a-524c7d70a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:24:01.928557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339ac5d-78c7-4dde-8d8a-524c7d70a6a5 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:24:01.929917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 776/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:24:01.935159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6a57e-e0b7-4727-9ee4-1f635c4b2a70 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:24:01.935568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6a57e-e0b7-4727-9ee4-1f635c4b2a70 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:24:01.935704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6a57e-e0b7-4727-9ee4-1f635c4b2a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:24:01.953129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2df6a57e-e0b7-4727-9ee4-1f635c4b2a70 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:24:01.954364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2df6a57e-e0b7-4727-9ee4-1f635c4b2a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:24:01.964595 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 757/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:24:02.232093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339ac5d-78c7-4dde-8d8a-524c7d70a6a5 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:24:02.233992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4339ac5d-78c7-4dde-8d8a-524c7d70a6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:24:02.290076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339ac5d-78c7-4dde-8d8a-524c7d70a6a5 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:24:02.294042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fb62d-0b1c-4011-9331-7131cf2ba4dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:24:02.294700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb62d-0b1c-4011-9331-7131cf2ba4dc service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:24:02.294985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb62d-0b1c-4011-9331-7131cf2ba4dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:24:02.295255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb62d-0b1c-4011-9331-7131cf2ba4dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:24:02.303693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fb62d-0b1c-4011-9331-7131cf2ba4dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:24:02.305104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fb62d-0b1c-4011-9331-7131cf2ba4dc service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:24:02.314765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 777/1534] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:24:04.634689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae3dc3-a71e-4032-b296-4fd876810077 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:24:04.635291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae3dc3-a71e-4032-b296-4fd876810077 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:24:04.635415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae3dc3-a71e-4032-b296-4fd876810077 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:24:04.636819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 758/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Apr 12 00:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:24:04.642105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4687ea-b599-46b3-becc-2f166a6009f1 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:24:04.642584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4687ea-b599-46b3-becc-2f166a6009f1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:24:04.642692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4687ea-b599-46b3-becc-2f166a6009f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:24:04.661109 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-dd4687ea-b599-46b3-becc-2f166a6009f1 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:24:04.662320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-dd4687ea-b599-46b3-becc-2f166a6009f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:24:04.670702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 778/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Apr 12 00:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:24:04.942919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281458d-76e2-4bfe-a432-d045296dea26 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:24:04.943224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281458d-76e2-4bfe-a432-d045296dea26 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:24:04.943501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281458d-76e2-4bfe-a432-d045296dea26 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:24:04.944890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 759/1537] 10.222.0.32 () {54 vars in 962 bytes} [Tue Apr 12 00:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:24:04.950343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f6e34-a8d5-4508-9eaf-c8b103934d7c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:24:04.950654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f6e34-a8d5-4508-9eaf-c8b103934d7c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:24:04.950981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f6e34-a8d5-4508-9eaf-c8b103934d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:24:04.968762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ba1f6e34-a8d5-4508-9eaf-c8b103934d7c None None] MFA Rules not processed for user `73a39479834440ffa85fbc0d58a257d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:24:04.969936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ba1f6e34-a8d5-4508-9eaf-c8b103934d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:24:04.976326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 779/1538] 10.222.0.32 () {58 vars in 1059 bytes} [Tue Apr 12 00:24:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:24:04.983946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281458d-76e2-4bfe-a432-d045296dea26 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:24:04.995134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281458d-76e2-4bfe-a432-d045296dea26 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:24:04.998725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a07a5-6c27-499c-b224-7d2855074282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:24:04.999404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a07a5-6c27-499c-b224-7d2855074282 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:24:04.999687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a07a5-6c27-499c-b224-7d2855074282 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:24:04.999997 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a07a5-6c27-499c-b224-7d2855074282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:24:05.008779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a07a5-6c27-499c-b224-7d2855074282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:24:05.010356 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a07a5-6c27-499c-b224-7d2855074282 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:24:05.019835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 760/1539] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:35.221693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b62403-9c2b-42f8-afc5-8896ff3ea842 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.222365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b62403-9c2b-42f8-afc5-8896ff3ea842 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.222365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b62403-9c2b-42f8-afc5-8896ff3ea842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.237272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e21b4-d25e-471f-b6a9-1047be5e7a46 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.238440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e21b4-d25e-471f-b6a9-1047be5e7a46 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.238975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e21b4-d25e-471f-b6a9-1047be5e7a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.260773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-75b62403-9c2b-42f8-afc5-8896ff3ea842 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.262136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-75b62403-9c2b-42f8-afc5-8896ff3ea842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.268598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-8a8e21b4-d25e-471f-b6a9-1047be5e7a46 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.269836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8a8e21b4-d25e-471f-b6a9-1047be5e7a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.280337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 780/1540] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.283435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 761/1541] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.291840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e845-76ec-4c87-b035-d6bbd098e048 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.292183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e845-76ec-4c87-b035-d6bbd098e048 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.292419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928e845-76ec-4c87-b035-d6bbd098e048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.294674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad9e90-0b46-4aa8-9b0d-241080f4be01 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.294980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad9e90-0b46-4aa8-9b0d-241080f4be01 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.295237 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad9e90-0b46-4aa8-9b0d-241080f4be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.323160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2bad9e90-0b46-4aa8-9b0d-241080f4be01 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.323395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-7928e845-76ec-4c87-b035-d6bbd098e048 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.324390 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2bad9e90-0b46-4aa8-9b0d-241080f4be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.324521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7928e845-76ec-4c87-b035-d6bbd098e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.340333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 781/1542] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.341628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 762/1543] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:25:35.343894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e845-76ec-4c87-b035-d6bbd098e048 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.346194 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad9e90-0b46-4aa8-9b0d-241080f4be01 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.354680 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928e845-76ec-4c87-b035-d6bbd098e048 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.355934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad9e90-0b46-4aa8-9b0d-241080f4be01 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.366388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88446b22-d836-4d0a-86cf-a2f929d7c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.367173 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88446b22-d836-4d0a-86cf-a2f929d7c028 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.367456 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88446b22-d836-4d0a-86cf-a2f929d7c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.367730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88446b22-d836-4d0a-86cf-a2f929d7c028 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.368572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88446b22-d836-4d0a-86cf-a2f929d7c028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:35.368829 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.369032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88446b22-d836-4d0a-86cf-a2f929d7c028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.369490 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.369770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.370046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.370551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88446b22-d836-4d0a-86cf-a2f929d7c028 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.370794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:35.371100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.372247 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING py.warnings [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:25:35.372247 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: warnings.warn(msg) Apr 12 00:25:35.372247 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: Apr 12 00:25:35.373245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.393845 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 782/1544] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:25:35.395230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 763/1545] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:25:35.398948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88446b22-d836-4d0a-86cf-a2f929d7c028 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.399179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.411797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653c0e2-0f43-4797-bb1e-561c0b8afb1f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.412110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88446b22-d836-4d0a-86cf-a2f929d7c028 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.424917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98860bb-7051-4846-8f37-ca2ad19c3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.425610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98860bb-7051-4846-8f37-ca2ad19c3ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.425891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98860bb-7051-4846-8f37-ca2ad19c3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.426165 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98860bb-7051-4846-8f37-ca2ad19c3ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.426897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98860bb-7051-4846-8f37-ca2ad19c3ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.428075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING py.warnings [None req-a98860bb-7051-4846-8f37-ca2ad19c3ed1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:25:35.428075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: warnings.warn(msg) Apr 12 00:25:35.428075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: Apr 12 00:25:35.429201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfe321-84b2-40e1-8b19-4dda117356b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.429417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98860bb-7051-4846-8f37-ca2ad19c3ed1 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.429881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfe321-84b2-40e1-8b19-4dda117356b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.430163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfe321-84b2-40e1-8b19-4dda117356b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.430467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfe321-84b2-40e1-8b19-4dda117356b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.431269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfe321-84b2-40e1-8b19-4dda117356b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.433144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfe321-84b2-40e1-8b19-4dda117356b0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.485532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 783/1546] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/projects => generated 365 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:25:35.489547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98860bb-7051-4846-8f37-ca2ad19c3ed1 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.496970 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 764/1547] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:25:35.501084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfe321-84b2-40e1-8b19-4dda117356b0 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.610145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98860bb-7051-4846-8f37-ca2ad19c3ed1 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.625730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa27a02-e9d3-4a62-af09-5094775ee945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.626471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa27a02-e9d3-4a62-af09-5094775ee945 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.626756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa27a02-e9d3-4a62-af09-5094775ee945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.627032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa27a02-e9d3-4a62-af09-5094775ee945 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.627630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfe321-84b2-40e1-8b19-4dda117356b0 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.627760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa27a02-e9d3-4a62-af09-5094775ee945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.629689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa27a02-e9d3-4a62-af09-5094775ee945 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.635675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dac4e-b68b-4880-8927-6d0a054b0e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.636670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dac4e-b68b-4880-8927-6d0a054b0e2f admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.637333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dac4e-b68b-4880-8927-6d0a054b0e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.637635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dac4e-b68b-4880-8927-6d0a054b0e2f admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.638394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dac4e-b68b-4880-8927-6d0a054b0e2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.639474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING py.warnings [None req-823dac4e-b68b-4880-8927-6d0a054b0e2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:25:35.639474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: warnings.warn(msg) Apr 12 00:25:35.639474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: Apr 12 00:25:35.640728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dac4e-b68b-4880-8927-6d0a054b0e2f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.680697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 784/1548] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:25:35.683077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d7af2-e30a-487e-b078-f03d0725e0f3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.683587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d7af2-e30a-487e-b078-f03d0725e0f3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.684080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d7af2-e30a-487e-b078-f03d0725e0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.684290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 765/1549] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:35.686026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de4d4-62e1-4fef-be6e-dd401cd4ab5f None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.686542 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de4d4-62e1-4fef-be6e-dd401cd4ab5f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.687108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799de4d4-62e1-4fef-be6e-dd401cd4ab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.705858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a41d7af2-e30a-487e-b078-f03d0725e0f3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.707349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a41d7af2-e30a-487e-b078-f03d0725e0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.709649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-799de4d4-62e1-4fef-be6e-dd401cd4ab5f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.710969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-799de4d4-62e1-4fef-be6e-dd401cd4ab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.718094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 785/1550] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.719711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f45d-3adf-480a-8667-77781154490f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.720172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f45d-3adf-480a-8667-77781154490f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.720617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159f45d-3adf-480a-8667-77781154490f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.721253 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 766/1551] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.722878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b96fd6-ff9b-4498-88c3-04f8dd8ba91e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.723276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b96fd6-ff9b-4498-88c3-04f8dd8ba91e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.723742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b96fd6-ff9b-4498-88c3-04f8dd8ba91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.741509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e159f45d-3adf-480a-8667-77781154490f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.742722 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e159f45d-3adf-480a-8667-77781154490f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.745082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-68b96fd6-ff9b-4498-88c3-04f8dd8ba91e None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.746285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-68b96fd6-ff9b-4498-88c3-04f8dd8ba91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.751217 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 786/1552] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.752098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159f45d-3adf-480a-8667-77781154490f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.756591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 767/1553] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.762869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e159f45d-3adf-480a-8667-77781154490f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.763122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b96fd6-ff9b-4498-88c3-04f8dd8ba91e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.777008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b2772-650d-477a-912e-1aea412380fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.778026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b2772-650d-477a-912e-1aea412380fa admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.778337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b2772-650d-477a-912e-1aea412380fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.778640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b2772-650d-477a-912e-1aea412380fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.779406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b2772-650d-477a-912e-1aea412380fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.783776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b2772-650d-477a-912e-1aea412380fa admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.789104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b96fd6-ff9b-4498-88c3-04f8dd8ba91e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.797779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd05be-9f80-45cf-b21b-ac44ba87f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.798579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd05be-9f80-45cf-b21b-ac44ba87f25e admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.798867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd05be-9f80-45cf-b21b-ac44ba87f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.799144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd05be-9f80-45cf-b21b-ac44ba87f25e admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.799881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd05be-9f80-45cf-b21b-ac44ba87f25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.799984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 787/1554] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:35.801194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130b42d-ba37-42cf-80de-c571987846bb None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.801481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130b42d-ba37-42cf-80de-c571987846bb None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.801586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd05be-9f80-45cf-b21b-ac44ba87f25e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.801757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130b42d-ba37-42cf-80de-c571987846bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.812894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 768/1555] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:35.814645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff92e4-6905-4acb-942f-8a3bfa859afd None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.814942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff92e4-6905-4acb-942f-8a3bfa859afd None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.815211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff92e4-6905-4acb-942f-8a3bfa859afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.819965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5130b42d-ba37-42cf-80de-c571987846bb None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.821132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5130b42d-ba37-42cf-80de-c571987846bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.828845 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 788/1556] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.830053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f1c02-c1d4-4a8c-994b-631b40d88070 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.830366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f1c02-c1d4-4a8c-994b-631b40d88070 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.830642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f1c02-c1d4-4a8c-994b-631b40d88070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.833880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a6ff92e4-6905-4acb-942f-8a3bfa859afd None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.835121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a6ff92e4-6905-4acb-942f-8a3bfa859afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.842834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 769/1557] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.846539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010bf04-4820-4efa-b4a5-25cb7e51eacb None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.846539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010bf04-4820-4efa-b4a5-25cb7e51eacb None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.846539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010bf04-4820-4efa-b4a5-25cb7e51eacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.851058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-065f1c02-c1d4-4a8c-994b-631b40d88070 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.852215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-065f1c02-c1d4-4a8c-994b-631b40d88070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.859928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 789/1558] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.861116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df204d3-c5aa-4bc6-be52-5da64f293222 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.861400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df204d3-c5aa-4bc6-be52-5da64f293222 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.861672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df204d3-c5aa-4bc6-be52-5da64f293222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.863814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-9010bf04-4820-4efa-b4a5-25cb7e51eacb None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.865051 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9010bf04-4820-4efa-b4a5-25cb7e51eacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.872848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 770/1559] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.874105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac8822-8be2-49f3-b5c7-b264f1b474b2 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.874436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac8822-8be2-49f3-b5c7-b264f1b474b2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.874823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac8822-8be2-49f3-b5c7-b264f1b474b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.878717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3df204d3-c5aa-4bc6-be52-5da64f293222 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.879852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3df204d3-c5aa-4bc6-be52-5da64f293222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.889073 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 790/1560] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.890016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df204d3-c5aa-4bc6-be52-5da64f293222 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.893740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-69ac8822-8be2-49f3-b5c7-b264f1b474b2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:35.894953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-69ac8822-8be2-49f3-b5c7-b264f1b474b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:35.899346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df204d3-c5aa-4bc6-be52-5da64f293222 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.904070 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e2620-d51c-4883-be43-cd9c8d7b8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.904714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e2620-d51c-4883-be43-cd9c8d7b8759 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.904997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e2620-d51c-4883-be43-cd9c8d7b8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.905267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e2620-d51c-4883-be43-cd9c8d7b8759 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.906010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e2620-d51c-4883-be43-cd9c8d7b8759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.906416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 771/1561] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:35.907477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac8822-8be2-49f3-b5c7-b264f1b474b2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.907691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e2620-d51c-4883-be43-cd9c8d7b8759 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.917658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac8822-8be2-49f3-b5c7-b264f1b474b2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.918304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 791/1562] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:35.919072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e2620-d51c-4883-be43-cd9c8d7b8759 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.925318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bc03c-bd9a-4b09-8437-05e8496e9fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.925984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bc03c-bd9a-4b09-8437-05e8496e9fec admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.926302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bc03c-bd9a-4b09-8437-05e8496e9fec admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.926588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bc03c-bd9a-4b09-8437-05e8496e9fec admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.927318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bc03c-bd9a-4b09-8437-05e8496e9fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.928249 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e2620-d51c-4883-be43-cd9c8d7b8759 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.929001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bc03c-bd9a-4b09-8437-05e8496e9fec admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.932651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9a536-b333-4a1b-b8f8-b62c770df6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.933274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9a536-b333-4a1b-b8f8-b62c770df6bd admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.933553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9a536-b333-4a1b-b8f8-b62c770df6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.933826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d9a536-b333-4a1b-b8f8-b62c770df6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.934564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9a536-b333-4a1b-b8f8-b62c770df6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:35.934863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9a536-b333-4a1b-b8f8-b62c770df6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.936404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d9a536-b333-4a1b-b8f8-b62c770df6bd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.938836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 772/1563] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:35.942827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bc03c-bd9a-4b09-8437-05e8496e9fec admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.949836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 792/1564] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:25:35.950644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9a536-b333-4a1b-b8f8-b62c770df6bd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.953177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bc03c-bd9a-4b09-8437-05e8496e9fec admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.958049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b0a09-9e08-47dd-89ca-1138a58a1a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.959949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b0a09-9e08-47dd-89ca-1138a58a1a93 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.960297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b0a09-9e08-47dd-89ca-1138a58a1a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.960730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b0a09-9e08-47dd-89ca-1138a58a1a93 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.961447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b0a09-9e08-47dd-89ca-1138a58a1a93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:35.961750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b0a09-9e08-47dd-89ca-1138a58a1a93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.962909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d9a536-b333-4a1b-b8f8-b62c770df6bd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.963355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b0a09-9e08-47dd-89ca-1138a58a1a93 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.968520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1f73a-4c98-4d6f-8583-78d2b57e4c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.969275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1f73a-4c98-4d6f-8583-78d2b57e4c30 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.969567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1f73a-4c98-4d6f-8583-78d2b57e4c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.969843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1f73a-4c98-4d6f-8583-78d2b57e4c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.970732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1f73a-4c98-4d6f-8583-78d2b57e4c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:35.971040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1f73a-4c98-4d6f-8583-78d2b57e4c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.972602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1f73a-4c98-4d6f-8583-78d2b57e4c30 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:35.975715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 773/1565] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:25:35.976642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b0a09-9e08-47dd-89ca-1138a58a1a93 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:35.986286 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b0a09-9e08-47dd-89ca-1138a58a1a93 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:35.986947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 793/1566] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:25:35.992224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c6d5c-c753-46a4-bd6c-b14e14f1acc4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.992370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efe743-eebb-40df-b62c-dff562b5f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:35.992482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c6d5c-c753-46a4-bd6c-b14e14f1acc4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.992703 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c6d5c-c753-46a4-bd6c-b14e14f1acc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.992975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efe743-eebb-40df-b62c-dff562b5f514 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:35.993258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efe743-eebb-40df-b62c-dff562b5f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:35.993534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efe743-eebb-40df-b62c-dff562b5f514 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:35.994625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efe743-eebb-40df-b62c-dff562b5f514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:35.994942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efe743-eebb-40df-b62c-dff562b5f514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:35.996527 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60efe743-eebb-40df-b62c-dff562b5f514 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.008133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 774/1567] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:25:36.009358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e81b4a-50c2-46a1-8e3a-70d4b81b9951 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.009641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e81b4a-50c2-46a1-8e3a-70d4b81b9951 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.009847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-fa6c6d5c-c753-46a4-bd6c-b14e14f1acc4 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:36.009964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e81b4a-50c2-46a1-8e3a-70d4b81b9951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.011074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fa6c6d5c-c753-46a4-bd6c-b14e14f1acc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:36.018773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 794/1568] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:36.022484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c6d5c-c753-46a4-bd6c-b14e14f1acc4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.027026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-43e81b4a-50c2-46a1-8e3a-70d4b81b9951 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:36.028447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-43e81b4a-50c2-46a1-8e3a-70d4b81b9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:36.031143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c6d5c-c753-46a4-bd6c-b14e14f1acc4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.036046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 775/1569] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:36.036172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f74d17-c4c7-4200-9a49-60eec6a0ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.036772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e81b4a-50c2-46a1-8e3a-70d4b81b9951 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.037090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f74d17-c4c7-4200-9a49-60eec6a0ac62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.038006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f74d17-c4c7-4200-9a49-60eec6a0ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.038281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f74d17-c4c7-4200-9a49-60eec6a0ac62 admin admin] PATH_INFO: `/v3/projects/ab4b2a84b4e14e2f97768fe79385f8a9/users/925d4fd16dce4e5982c9a732037f3fc8/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.046405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e81b4a-50c2-46a1-8e3a-70d4b81b9951 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.051020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcab5d-64d6-44be-b3d7-2ec7126d4d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.051873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcab5d-64d6-44be-b3d7-2ec7126d4d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.052147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcab5d-64d6-44be-b3d7-2ec7126d4d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.052414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcab5d-64d6-44be-b3d7-2ec7126d4d71 admin admin] PATH_INFO: `/v3/projects/8b482c4c00e94a25ad8f0a9034e9e0e5/users/f0fad81c4cbd4335967e97fd7de9963d/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.052534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f74d17-c4c7-4200-9a49-60eec6a0ac62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4b2a84b4e14e2f97768fe79385f8a9, user_id=925d4fd16dce4e5982c9a732037f3fc8, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.054030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING py.warnings [None req-c8f74d17-c4c7-4200-9a49-60eec6a0ac62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:25:36.054030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: warnings.warn(msg) Apr 12 00:25:36.054030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: Apr 12 00:25:36.056000 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f74d17-c4c7-4200-9a49-60eec6a0ac62 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.067097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcab5d-64d6-44be-b3d7-2ec7126d4d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b482c4c00e94a25ad8f0a9034e9e0e5, user_id=f0fad81c4cbd4335967e97fd7de9963d, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.069419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 795/1570] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:36 2022] PUT /identity/v3/projects/ab4b2a84b4e14e2f97768fe79385f8a9/users/925d4fd16dce4e5982c9a732037f3fc8/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:36.069892 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcab5d-64d6-44be-b3d7-2ec7126d4d71 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.070290 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f74d17-c4c7-4200-9a49-60eec6a0ac62 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.086555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 776/1571] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:36 2022] PUT /identity/v3/projects/8b482c4c00e94a25ad8f0a9034e9e0e5/users/f0fad81c4cbd4335967e97fd7de9963d/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:36.087462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcab5d-64d6-44be-b3d7-2ec7126d4d71 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.132891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f74d17-c4c7-4200-9a49-60eec6a0ac62 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.148018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcab5d-64d6-44be-b3d7-2ec7126d4d71 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.152864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a222b0-402e-46ad-ab71-3afdc334f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.153518 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a222b0-402e-46ad-ab71-3afdc334f8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.153800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a222b0-402e-46ad-ab71-3afdc334f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.154072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a222b0-402e-46ad-ab71-3afdc334f8a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.154782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a222b0-402e-46ad-ab71-3afdc334f8a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.156672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a222b0-402e-46ad-ab71-3afdc334f8a4 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.181264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 777/1572] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.182053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a222b0-402e-46ad-ab71-3afdc334f8a4 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.191060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec61b82-8c8c-407a-af8d-4f6673f6cef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.191723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec61b82-8c8c-407a-af8d-4f6673f6cef1 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.192006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec61b82-8c8c-407a-af8d-4f6673f6cef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.192282 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec61b82-8c8c-407a-af8d-4f6673f6cef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.192957 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec61b82-8c8c-407a-af8d-4f6673f6cef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.195392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec61b82-8c8c-407a-af8d-4f6673f6cef1 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.224423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 796/1573] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.228397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec61b82-8c8c-407a-af8d-4f6673f6cef1 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.243624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a222b0-402e-46ad-ab71-3afdc334f8a4 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.285331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec61b82-8c8c-407a-af8d-4f6673f6cef1 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.289932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4193119-8147-4f22-b6ed-fd70bd6bddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.290615 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4193119-8147-4f22-b6ed-fd70bd6bddbb admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.290897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4193119-8147-4f22-b6ed-fd70bd6bddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.291163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4193119-8147-4f22-b6ed-fd70bd6bddbb admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.291837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4193119-8147-4f22-b6ed-fd70bd6bddbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.293703 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4193119-8147-4f22-b6ed-fd70bd6bddbb admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.297010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c70da-f07f-4658-982d-7dbfe8beb9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.297667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c70da-f07f-4658-982d-7dbfe8beb9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.297948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c70da-f07f-4658-982d-7dbfe8beb9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.298222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c70da-f07f-4658-982d-7dbfe8beb9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.298935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c70da-f07f-4658-982d-7dbfe8beb9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.300811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c70da-f07f-4658-982d-7dbfe8beb9c2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.318503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 797/1574] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.319368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4193119-8147-4f22-b6ed-fd70bd6bddbb admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.329184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 778/1575] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.329184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c70da-f07f-4658-982d-7dbfe8beb9c2 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.381813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4193119-8147-4f22-b6ed-fd70bd6bddbb admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.386393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca48e5-68a6-4a9d-83b1-45ad4276ba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.387020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c70da-f07f-4658-982d-7dbfe8beb9c2 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.387155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca48e5-68a6-4a9d-83b1-45ad4276ba74 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.387318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca48e5-68a6-4a9d-83b1-45ad4276ba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.387591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca48e5-68a6-4a9d-83b1-45ad4276ba74 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.388300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca48e5-68a6-4a9d-83b1-45ad4276ba74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:36.388598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca48e5-68a6-4a9d-83b1-45ad4276ba74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.390181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca48e5-68a6-4a9d-83b1-45ad4276ba74 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.392138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e52e0-0f89-4c99-9faf-e1464f5f770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.392815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e52e0-0f89-4c99-9faf-e1464f5f770e admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.393094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e52e0-0f89-4c99-9faf-e1464f5f770e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.393366 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e52e0-0f89-4c99-9faf-e1464f5f770e admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.394073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e52e0-0f89-4c99-9faf-e1464f5f770e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:36.394409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e52e0-0f89-4c99-9faf-e1464f5f770e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.396027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e52e0-0f89-4c99-9faf-e1464f5f770e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.402035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 798/1576] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:25:36.403552 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d648-e289-4e9c-949d-aa633742c64b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.403892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d648-e289-4e9c-949d-aa633742c64b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.404173 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463d648-e289-4e9c-949d-aa633742c64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.414786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 779/1577] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:25:36.414786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bebfd-1293-472f-ad61-c25f7acd5ebb None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.414786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bebfd-1293-472f-ad61-c25f7acd5ebb None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.414786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bebfd-1293-472f-ad61-c25f7acd5ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.428089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5a0bebfd-1293-472f-ad61-c25f7acd5ebb None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:36.429319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5a0bebfd-1293-472f-ad61-c25f7acd5ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:36.435664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e463d648-e289-4e9c-949d-aa633742c64b None None] MFA Rules not processed for user `925d4fd16dce4e5982c9a732037f3fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:36.436814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e463d648-e289-4e9c-949d-aa633742c64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:36.436935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 780/1578] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:36.437694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bebfd-1293-472f-ad61-c25f7acd5ebb None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.449115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bebfd-1293-472f-ad61-c25f7acd5ebb None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.453776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05f59d-f434-4a84-ab93-43fb1b75ad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.454455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05f59d-f434-4a84-ab93-43fb1b75ad15 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.454743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05f59d-f434-4a84-ab93-43fb1b75ad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.455019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05f59d-f434-4a84-ab93-43fb1b75ad15 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.455702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05f59d-f434-4a84-ab93-43fb1b75ad15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.457614 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05f59d-f434-4a84-ab93-43fb1b75ad15 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.477547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 781/1579] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.478157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05f59d-f434-4a84-ab93-43fb1b75ad15 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.487481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05f59d-f434-4a84-ab93-43fb1b75ad15 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.492454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1878-f247-449f-a3f5-70a1d23e4469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.493112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1878-f247-449f-a3f5-70a1d23e4469 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.493355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1878-f247-449f-a3f5-70a1d23e4469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.493686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb1878-f247-449f-a3f5-70a1d23e4469 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.494375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1878-f247-449f-a3f5-70a1d23e4469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.496260 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb1878-f247-449f-a3f5-70a1d23e4469 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.500319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 799/1580] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:36.501127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463d648-e289-4e9c-949d-aa633742c64b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.513856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463d648-e289-4e9c-949d-aa633742c64b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.518474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 782/1581] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/users => generated 294 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.519075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900409a-57a0-4b61-b2ed-d8647bdcea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.519292 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1878-f247-449f-a3f5-70a1d23e4469 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.519948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900409a-57a0-4b61-b2ed-d8647bdcea8e admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.520199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900409a-57a0-4b61-b2ed-d8647bdcea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.520481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900409a-57a0-4b61-b2ed-d8647bdcea8e admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.521318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900409a-57a0-4b61-b2ed-d8647bdcea8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.523667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900409a-57a0-4b61-b2ed-d8647bdcea8e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.529126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb1878-f247-449f-a3f5-70a1d23e4469 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.533937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e4c8a-a5f4-4948-a417-b38e7843407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.534617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e4c8a-a5f4-4948-a417-b38e7843407c admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.534895 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e4c8a-a5f4-4948-a417-b38e7843407c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.535167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e4c8a-a5f4-4948-a417-b38e7843407c admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.535833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e4c8a-a5f4-4948-a417-b38e7843407c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.537821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e4c8a-a5f4-4948-a417-b38e7843407c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.547379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 800/1582] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.547379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900409a-57a0-4b61-b2ed-d8647bdcea8e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.556042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900409a-57a0-4b61-b2ed-d8647bdcea8e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.562280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 783/1583] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.562280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e4c8a-a5f4-4948-a417-b38e7843407c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.563551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a57a3-f05f-4a57-abc6-befb24efdac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.564236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a57a3-f05f-4a57-abc6-befb24efdac0 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.564553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a57a3-f05f-4a57-abc6-befb24efdac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.564842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a57a3-f05f-4a57-abc6-befb24efdac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.565578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a57a3-f05f-4a57-abc6-befb24efdac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.568713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a57a3-f05f-4a57-abc6-befb24efdac0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.570838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e4c8a-a5f4-4948-a417-b38e7843407c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.575443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65391eb7-6719-411e-8f2e-500dcb845d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.576071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65391eb7-6719-411e-8f2e-500dcb845d5d admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.576351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65391eb7-6719-411e-8f2e-500dcb845d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.576736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65391eb7-6719-411e-8f2e-500dcb845d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.577440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65391eb7-6719-411e-8f2e-500dcb845d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.579323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65391eb7-6719-411e-8f2e-500dcb845d5d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.595056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 801/1584] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.596135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a57a3-f05f-4a57-abc6-befb24efdac0 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.610688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 784/1585] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.610688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65391eb7-6719-411e-8f2e-500dcb845d5d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.649007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a57a3-f05f-4a57-abc6-befb24efdac0 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.667224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65391eb7-6719-411e-8f2e-500dcb845d5d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.672157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002d60e-fb6b-42fd-ae12-d16d06918595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.672978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002d60e-fb6b-42fd-ae12-d16d06918595 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.673388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002d60e-fb6b-42fd-ae12-d16d06918595 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.673695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002d60e-fb6b-42fd-ae12-d16d06918595 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.674459 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002d60e-fb6b-42fd-ae12-d16d06918595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.676089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002d60e-fb6b-42fd-ae12-d16d06918595 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.686397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 785/1586] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:36.687396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002d60e-fb6b-42fd-ae12-d16d06918595 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.702216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bafb35-e1b4-45f5-a899-3e0811f94056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.702882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bafb35-e1b4-45f5-a899-3e0811f94056 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.703163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bafb35-e1b4-45f5-a899-3e0811f94056 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.703431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bafb35-e1b4-45f5-a899-3e0811f94056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.712296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bafb35-e1b4-45f5-a899-3e0811f94056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.713707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bafb35-e1b4-45f5-a899-3e0811f94056 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.723392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 802/1587] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:36.724371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bafb35-e1b4-45f5-a899-3e0811f94056 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.733978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bafb35-e1b4-45f5-a899-3e0811f94056 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.738787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002d60e-fb6b-42fd-ae12-d16d06918595 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.739853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f92522-b98e-49e3-a4b4-3cb5df3edd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.740320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f92522-b98e-49e3-a4b4-3cb5df3edd7d admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.740668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f92522-b98e-49e3-a4b4-3cb5df3edd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.741003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f92522-b98e-49e3-a4b4-3cb5df3edd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.741794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f92522-b98e-49e3-a4b4-3cb5df3edd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.743476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f92522-b98e-49e3-a4b4-3cb5df3edd7d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.743607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bf854-09d0-4936-a693-ff4d5e656397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.744399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bf854-09d0-4936-a693-ff4d5e656397 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.744702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bf854-09d0-4936-a693-ff4d5e656397 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.745040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661bf854-09d0-4936-a693-ff4d5e656397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.753827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 803/1588] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:36.754811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f92522-b98e-49e3-a4b4-3cb5df3edd7d admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.765496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f92522-b98e-49e3-a4b4-3cb5df3edd7d admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.770019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7f006-2a8b-4168-a676-27c970bb81b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.770748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7f006-2a8b-4168-a676-27c970bb81b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.771028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7f006-2a8b-4168-a676-27c970bb81b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.771304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7f006-2a8b-4168-a676-27c970bb81b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.772643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7f006-2a8b-4168-a676-27c970bb81b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.774939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7f006-2a8b-4168-a676-27c970bb81b1 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.785941 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 804/1589] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:36.787036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7f006-2a8b-4168-a676-27c970bb81b1 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.796704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7f006-2a8b-4168-a676-27c970bb81b1 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.801644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5128b-1728-4c94-999c-a1de0f355651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.802337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5128b-1728-4c94-999c-a1de0f355651 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.802709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5128b-1728-4c94-999c-a1de0f355651 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.803034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5128b-1728-4c94-999c-a1de0f355651 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.803734 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5128b-1728-4c94-999c-a1de0f355651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.805317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5128b-1728-4c94-999c-a1de0f355651 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.816063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 805/1590] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:36.817632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5128b-1728-4c94-999c-a1de0f355651 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.820492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bf854-09d0-4936-a693-ff4d5e656397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.822532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661bf854-09d0-4936-a693-ff4d5e656397 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.829336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5128b-1728-4c94-999c-a1de0f355651 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.833065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 786/1591] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:36.833865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bf854-09d0-4936-a693-ff4d5e656397 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.834777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcce81-35fb-45e7-809f-d8e6ec0a64a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.835466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcce81-35fb-45e7-809f-d8e6ec0a64a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.835729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcce81-35fb-45e7-809f-d8e6ec0a64a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.836003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fcce81-35fb-45e7-809f-d8e6ec0a64a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.836846 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcce81-35fb-45e7-809f-d8e6ec0a64a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.838768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fcce81-35fb-45e7-809f-d8e6ec0a64a8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.845439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661bf854-09d0-4936-a693-ff4d5e656397 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.851426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2e2b5-9058-45ac-a61c-30136a6e2707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.852283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2e2b5-9058-45ac-a61c-30136a6e2707 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.852681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2e2b5-9058-45ac-a61c-30136a6e2707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.853107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2e2b5-9058-45ac-a61c-30136a6e2707 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.853863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2e2b5-9058-45ac-a61c-30136a6e2707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.855960 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2e2b5-9058-45ac-a61c-30136a6e2707 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.864411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 806/1592] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.865312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcce81-35fb-45e7-809f-d8e6ec0a64a8 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.879213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fcce81-35fb-45e7-809f-d8e6ec0a64a8 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.884903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84ee60-c92e-4348-8883-1c9c8fded4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.885678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ee60-c92e-4348-8883-1c9c8fded4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.885985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ee60-c92e-4348-8883-1c9c8fded4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.886223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84ee60-c92e-4348-8883-1c9c8fded4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.889508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 787/1593] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:36 2022] POST /identity/v3/users => generated 279 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:36.889778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84ee60-c92e-4348-8883-1c9c8fded4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.889874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2e2b5-9058-45ac-a61c-30136a6e2707 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.889961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84ee60-c92e-4348-8883-1c9c8fded4f3 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.899866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2e2b5-9058-45ac-a61c-30136a6e2707 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.905278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 807/1594] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:36.905715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3456185-391a-4758-ad55-40a622c62771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.906128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84ee60-c92e-4348-8883-1c9c8fded4f3 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.906929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3456185-391a-4758-ad55-40a622c62771 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.907275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3456185-391a-4758-ad55-40a622c62771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.907476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3456185-391a-4758-ad55-40a622c62771 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.908203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3456185-391a-4758-ad55-40a622c62771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.909955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3456185-391a-4758-ad55-40a622c62771 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.922508 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84ee60-c92e-4348-8883-1c9c8fded4f3 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.928280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ba8aa-ff84-4f48-9b66-53900466c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.929003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ba8aa-ff84-4f48-9b66-53900466c012 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.929526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ba8aa-ff84-4f48-9b66-53900466c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.929812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ba8aa-ff84-4f48-9b66-53900466c012 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.930621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ba8aa-ff84-4f48-9b66-53900466c012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.932647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ba8aa-ff84-4f48-9b66-53900466c012 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.937397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 788/1595] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:36.938333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3456185-391a-4758-ad55-40a622c62771 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.950294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3456185-391a-4758-ad55-40a622c62771 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.950445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 808/1596] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:36.951383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ba8aa-ff84-4f48-9b66-53900466c012 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.956136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e8624-9eca-4dd9-9cc8-52188392bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.956891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8624-9eca-4dd9-9cc8-52188392bdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.957238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8624-9eca-4dd9-9cc8-52188392bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.957709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e8624-9eca-4dd9-9cc8-52188392bdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.958550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e8624-9eca-4dd9-9cc8-52188392bdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.960289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449e8624-9eca-4dd9-9cc8-52188392bdd4 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.965760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ba8aa-ff84-4f48-9b66-53900466c012 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:36.973669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ad750-a8de-4c96-bc41-a2783ff31b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:36.977948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 789/1597] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:36.978090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ad750-a8de-4c96-bc41-a2783ff31b1f admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:36.978090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ad750-a8de-4c96-bc41-a2783ff31b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:36.978090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ad750-a8de-4c96-bc41-a2783ff31b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:36.978664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e8624-9eca-4dd9-9cc8-52188392bdd4 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:36.978748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ad750-a8de-4c96-bc41-a2783ff31b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:36.978824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ad750-a8de-4c96-bc41-a2783ff31b1f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:36.990616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 809/1598] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:36.991531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ad750-a8de-4c96-bc41-a2783ff31b1f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.001773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e8624-9eca-4dd9-9cc8-52188392bdd4 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.003217 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ad750-a8de-4c96-bc41-a2783ff31b1f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.007376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb39a8-28be-4f56-a111-87bcc49c08fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.008010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb39a8-28be-4f56-a111-87bcc49c08fe admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.008298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb39a8-28be-4f56-a111-87bcc49c08fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.008577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb39a8-28be-4f56-a111-87bcc49c08fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.008771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e5343-8d86-4228-bbeb-a9e7a7a9a9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.009349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb39a8-28be-4f56-a111-87bcc49c08fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.009655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e5343-8d86-4228-bbeb-a9e7a7a9a9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.009937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e5343-8d86-4228-bbeb-a9e7a7a9a9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.010212 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e5343-8d86-4228-bbeb-a9e7a7a9a9fa admin admin] PATH_INFO: `/v3/projects/587761ad1ee449b783e09cd1ae3fc3ae/users/8826856e447c4db78780cef1ce5729d8/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.011019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb39a8-28be-4f56-a111-87bcc49c08fe admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.028155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e5343-8d86-4228-bbeb-a9e7a7a9a9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=587761ad1ee449b783e09cd1ae3fc3ae, user_id=8826856e447c4db78780cef1ce5729d8, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.032080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e5343-8d86-4228-bbeb-a9e7a7a9a9fa admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.035187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 790/1599] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:37.036226 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb39a8-28be-4f56-a111-87bcc49c08fe admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.052213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb39a8-28be-4f56-a111-87bcc49c08fe admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.056325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 810/1600] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:36 2022] PUT /identity/v3/projects/587761ad1ee449b783e09cd1ae3fc3ae/users/8826856e447c4db78780cef1ce5729d8/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:37.057572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e5343-8d86-4228-bbeb-a9e7a7a9a9fa admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.134764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e5343-8d86-4228-bbeb-a9e7a7a9a9fa admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.139503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dbef2-d0f3-4609-9d37-8a8542b74352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.140665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dbef2-d0f3-4609-9d37-8a8542b74352 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.141627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eb4df-4a1b-4ece-9c5d-367ae24c896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.142138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dbef2-d0f3-4609-9d37-8a8542b74352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.143023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eb4df-4a1b-4ece-9c5d-367ae24c896c admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.143394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eb4df-4a1b-4ece-9c5d-367ae24c896c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.143781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dbef2-d0f3-4609-9d37-8a8542b74352 admin admin] PATH_INFO: `/v3/projects/fbac78e6502d4aa7a1d7d9799921c917/users/837b3d8924b24bec9dd06efaa19fd045/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.143919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eb4df-4a1b-4ece-9c5d-367ae24c896c admin admin] PATH_INFO: `/v3/projects/d3610d0185cf40548de23d406b26a421/users/bdc08edc0e354ea0b8e41a2d81f3d9d4/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.165904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eb4df-4a1b-4ece-9c5d-367ae24c896c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3610d0185cf40548de23d406b26a421, user_id=bdc08edc0e354ea0b8e41a2d81f3d9d4, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.170150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eb4df-4a1b-4ece-9c5d-367ae24c896c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.179982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dbef2-d0f3-4609-9d37-8a8542b74352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbac78e6502d4aa7a1d7d9799921c917, user_id=837b3d8924b24bec9dd06efaa19fd045, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.185323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dbef2-d0f3-4609-9d37-8a8542b74352 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.186218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 811/1601] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:37 2022] PUT /identity/v3/projects/d3610d0185cf40548de23d406b26a421/users/bdc08edc0e354ea0b8e41a2d81f3d9d4/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:37.187898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eb4df-4a1b-4ece-9c5d-367ae24c896c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.217492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 791/1602] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:37 2022] PUT /identity/v3/projects/fbac78e6502d4aa7a1d7d9799921c917/users/837b3d8924b24bec9dd06efaa19fd045/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:37.218360 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dbef2-d0f3-4609-9d37-8a8542b74352 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.273782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eb4df-4a1b-4ece-9c5d-367ae24c896c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.297883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dbef2-d0f3-4609-9d37-8a8542b74352 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.303519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce790ff9-b5fd-477a-8aec-82edac4647a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.304278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce790ff9-b5fd-477a-8aec-82edac4647a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.304629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce790ff9-b5fd-477a-8aec-82edac4647a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.304977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce790ff9-b5fd-477a-8aec-82edac4647a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.305876 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce790ff9-b5fd-477a-8aec-82edac4647a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.307610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce790ff9-b5fd-477a-8aec-82edac4647a1 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.318724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 792/1603] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:37.319664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce790ff9-b5fd-477a-8aec-82edac4647a1 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.331088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce790ff9-b5fd-477a-8aec-82edac4647a1 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.337897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34997d56-6513-46b0-86b5-4e6c7383b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.338599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00470904-90cc-4b82-9e04-252ae2af0848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.338757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34997d56-6513-46b0-86b5-4e6c7383b512 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.338933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34997d56-6513-46b0-86b5-4e6c7383b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.339162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34997d56-6513-46b0-86b5-4e6c7383b512 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.339493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00470904-90cc-4b82-9e04-252ae2af0848 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.339778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00470904-90cc-4b82-9e04-252ae2af0848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.339901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34997d56-6513-46b0-86b5-4e6c7383b512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.340067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00470904-90cc-4b82-9e04-252ae2af0848 admin admin] PATH_INFO: `/v3/projects/c08909d19c8341c5b47846b0cee54fd8/users/e548e01902ba41e79667ed56d602f19a/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.342086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34997d56-6513-46b0-86b5-4e6c7383b512 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.354961 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 793/1604] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:37.359637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00470904-90cc-4b82-9e04-252ae2af0848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08909d19c8341c5b47846b0cee54fd8, user_id=e548e01902ba41e79667ed56d602f19a, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.359819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893389c-fbf4-4cb5-9776-a31a64a545a5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.359930 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893389c-fbf4-4cb5-9776-a31a64a545a5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.360251 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893389c-fbf4-4cb5-9776-a31a64a545a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.361938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00470904-90cc-4b82-9e04-252ae2af0848 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.378657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 812/1605] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:37 2022] PUT /identity/v3/projects/c08909d19c8341c5b47846b0cee54fd8/users/e548e01902ba41e79667ed56d602f19a/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:37.380046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc663a34-b3ba-4df7-989d-33ee6f8be524 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.380335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc663a34-b3ba-4df7-989d-33ee6f8be524 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.380616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc663a34-b3ba-4df7-989d-33ee6f8be524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.398417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-8893389c-fbf4-4cb5-9776-a31a64a545a5 None None] MFA Rules not processed for user `8826856e447c4db78780cef1ce5729d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:37.400751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8893389c-fbf4-4cb5-9776-a31a64a545a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:37.402822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-bc663a34-b3ba-4df7-989d-33ee6f8be524 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:37.404660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bc663a34-b3ba-4df7-989d-33ee6f8be524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:37.494130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 794/1606] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:37.494130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a43c-d14c-4ab5-9a3d-98edb3237d73 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.494130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a43c-d14c-4ab5-9a3d-98edb3237d73 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.494130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12a43c-d14c-4ab5-9a3d-98edb3237d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.526624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ee12a43c-d14c-4ab5-9a3d-98edb3237d73 None None] MFA Rules not processed for user `837b3d8924b24bec9dd06efaa19fd045`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:37.528006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ee12a43c-d14c-4ab5-9a3d-98edb3237d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:37.536028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 813/1607] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:37.536988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc663a34-b3ba-4df7-989d-33ee6f8be524 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.554087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc663a34-b3ba-4df7-989d-33ee6f8be524 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.562269 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d15866-ee4e-4a0d-bbf9-c10721d0b694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.563333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d15866-ee4e-4a0d-bbf9-c10721d0b694 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.563825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d15866-ee4e-4a0d-bbf9-c10721d0b694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.564124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d15866-ee4e-4a0d-bbf9-c10721d0b694 admin admin] PATH_INFO: `/v3/projects/7bdba79df5fc4c3faa187bd65479d3f7/users/b434038833084579adf853df718315b2/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.588416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d15866-ee4e-4a0d-bbf9-c10721d0b694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bdba79df5fc4c3faa187bd65479d3f7, user_id=b434038833084579adf853df718315b2, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.593081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d15866-ee4e-4a0d-bbf9-c10721d0b694 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.613252 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 814/1608] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:37 2022] PUT /identity/v3/projects/7bdba79df5fc4c3faa187bd65479d3f7/users/b434038833084579adf853df718315b2/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:37.613920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d15866-ee4e-4a0d-bbf9-c10721d0b694 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.630596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 795/1609] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:37.632239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0631c1-ebca-40de-a0a1-9a80bf4a489c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.632576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0631c1-ebca-40de-a0a1-9a80bf4a489c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.632818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0631c1-ebca-40de-a0a1-9a80bf4a489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.650291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fb0631c1-ebca-40de-a0a1-9a80bf4a489c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:37.651503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fb0631c1-ebca-40de-a0a1-9a80bf4a489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:37.711486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d15866-ee4e-4a0d-bbf9-c10721d0b694 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.716502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac634267-1107-474f-8b2c-f6c02c1cdd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.718613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac634267-1107-474f-8b2c-f6c02c1cdd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.719006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac634267-1107-474f-8b2c-f6c02c1cdd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.719494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac634267-1107-474f-8b2c-f6c02c1cdd77 admin admin] PATH_INFO: `/v3/projects/838379d3d4634b25b49af9f398275792/users/8f99446e95464c34a81fcf3464ad0d09/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.737245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac634267-1107-474f-8b2c-f6c02c1cdd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838379d3d4634b25b49af9f398275792, user_id=8f99446e95464c34a81fcf3464ad0d09, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.740587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac634267-1107-474f-8b2c-f6c02c1cdd77 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.764499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 796/1610] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:37.766128 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0631c1-ebca-40de-a0a1-9a80bf4a489c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.773635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 815/1611] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:37 2022] PUT /identity/v3/projects/838379d3d4634b25b49af9f398275792/users/8f99446e95464c34a81fcf3464ad0d09/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:37.774595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac634267-1107-474f-8b2c-f6c02c1cdd77 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.793667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0631c1-ebca-40de-a0a1-9a80bf4a489c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.847882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac634267-1107-474f-8b2c-f6c02c1cdd77 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:37.851801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644775f8-bf24-4650-92e1-fe5e1005cbeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.852438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644775f8-bf24-4650-92e1-fe5e1005cbeb service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.852703 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644775f8-bf24-4650-92e1-fe5e1005cbeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.852979 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644775f8-bf24-4650-92e1-fe5e1005cbeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.873117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910458a8-04b5-4c9a-b9fe-7a47b16b5b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:37.873884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910458a8-04b5-4c9a-b9fe-7a47b16b5b54 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.874243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910458a8-04b5-4c9a-b9fe-7a47b16b5b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.874612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910458a8-04b5-4c9a-b9fe-7a47b16b5b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.875813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910458a8-04b5-4c9a-b9fe-7a47b16b5b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.877654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910458a8-04b5-4c9a-b9fe-7a47b16b5b54 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.910405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 797/1612] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:37 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:37.911632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6577-140e-43fa-8113-a94a982cd60d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:37.912031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6577-140e-43fa-8113-a94a982cd60d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:37.912455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a6577-140e-43fa-8113-a94a982cd60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:37.938631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fb2a6577-140e-43fa-8113-a94a982cd60d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:37.940576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fb2a6577-140e-43fa-8113-a94a982cd60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:37.942421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644775f8-bf24-4650-92e1-fe5e1005cbeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:37.944200 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644775f8-bf24-4650-92e1-fe5e1005cbeb service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:37.958823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 816/1613] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:37.960686 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644775f8-bf24-4650-92e1-fe5e1005cbeb service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:37.972230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644775f8-bf24-4650-92e1-fe5e1005cbeb service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.015307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 798/1614] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:38.020555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60011c3c-83cc-4085-935c-0c62fc2618fb None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.021487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60011c3c-83cc-4085-935c-0c62fc2618fb None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.021487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60011c3c-83cc-4085-935c-0c62fc2618fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.057839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-60011c3c-83cc-4085-935c-0c62fc2618fb None None] MFA Rules not processed for user `8f99446e95464c34a81fcf3464ad0d09`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:38.059921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-60011c3c-83cc-4085-935c-0c62fc2618fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:38.115245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405b2c-5e4d-432d-8f4d-a4fc97d468bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.119469 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405b2c-5e4d-432d-8f4d-a4fc97d468bc admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.119793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405b2c-5e4d-432d-8f4d-a4fc97d468bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.122374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405b2c-5e4d-432d-8f4d-a4fc97d468bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.126952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405b2c-5e4d-432d-8f4d-a4fc97d468bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.130361 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405b2c-5e4d-432d-8f4d-a4fc97d468bc admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.172696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 817/1615] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:37 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:38.172696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405b2c-5e4d-432d-8f4d-a4fc97d468bc admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.175420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 799/1616] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:38 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:38.176589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60011c3c-83cc-4085-935c-0c62fc2618fb None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.194841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60011c3c-83cc-4085-935c-0c62fc2618fb None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.261876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405b2c-5e4d-432d-8f4d-a4fc97d468bc admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.267999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d981988-379c-4131-a621-4d431c5b3d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.268674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d981988-379c-4131-a621-4d431c5b3d91 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.269013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d981988-379c-4131-a621-4d431c5b3d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.269542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d981988-379c-4131-a621-4d431c5b3d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.301478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716878e8-3bd7-4ed2-ad3a-c76c534d778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.302192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716878e8-3bd7-4ed2-ad3a-c76c534d778b admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.302728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716878e8-3bd7-4ed2-ad3a-c76c534d778b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.303118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716878e8-3bd7-4ed2-ad3a-c76c534d778b admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.303861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716878e8-3bd7-4ed2-ad3a-c76c534d778b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.305910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716878e8-3bd7-4ed2-ad3a-c76c534d778b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.342527 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 800/1617] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:38 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:38.345123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716878e8-3bd7-4ed2-ad3a-c76c534d778b admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.365781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716878e8-3bd7-4ed2-ad3a-c76c534d778b admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.372480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07a62-d303-42a0-ab8c-2a6ae64e1495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.373550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07a62-d303-42a0-ab8c-2a6ae64e1495 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.375299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07a62-d303-42a0-ab8c-2a6ae64e1495 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.376581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07a62-d303-42a0-ab8c-2a6ae64e1495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.378684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d981988-379c-4131-a621-4d431c5b3d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.380139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d981988-379c-4131-a621-4d431c5b3d91 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.391407 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f07a62-d303-42a0-ab8c-2a6ae64e1495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.394391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f07a62-d303-42a0-ab8c-2a6ae64e1495 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.403564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 818/1618] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:38.404428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d981988-379c-4131-a621-4d431c5b3d91 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.409363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 801/1619] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:38.410448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07a62-d303-42a0-ab8c-2a6ae64e1495 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.416816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d981988-379c-4131-a621-4d431c5b3d91 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.422975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99434d2-c982-420a-aa15-a72316175675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.423836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99434d2-c982-420a-aa15-a72316175675 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.424275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99434d2-c982-420a-aa15-a72316175675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.424738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99434d2-c982-420a-aa15-a72316175675 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.425885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99434d2-c982-420a-aa15-a72316175675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.428072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99434d2-c982-420a-aa15-a72316175675 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.436239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07a62-d303-42a0-ab8c-2a6ae64e1495 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.448897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd66219-35a2-4f16-84a1-5e8eac4f44b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.449887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd66219-35a2-4f16-84a1-5e8eac4f44b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.450179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd66219-35a2-4f16-84a1-5e8eac4f44b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.450509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd66219-35a2-4f16-84a1-5e8eac4f44b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.451195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd66219-35a2-4f16-84a1-5e8eac4f44b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.453756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd66219-35a2-4f16-84a1-5e8eac4f44b5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.463828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 819/1620] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:38 2022] POST /identity/v3/users => generated 300 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:38.470083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99434d2-c982-420a-aa15-a72316175675 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.493602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99434d2-c982-420a-aa15-a72316175675 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.497584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 802/1621] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:38 2022] POST /identity/v3/projects => generated 355 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:38.498945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd66219-35a2-4f16-84a1-5e8eac4f44b5 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.607874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd66219-35a2-4f16-84a1-5e8eac4f44b5 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.613866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa58f69-e9a9-4a98-ac98-d42680cfed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.614977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa58f69-e9a9-4a98-ac98-d42680cfed01 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.616038 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa58f69-e9a9-4a98-ac98-d42680cfed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.617373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa58f69-e9a9-4a98-ac98-d42680cfed01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.618964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa58f69-e9a9-4a98-ac98-d42680cfed01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.623455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa58f69-e9a9-4a98-ac98-d42680cfed01 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.625349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aee45-b0b9-4f91-b606-ae36687e8727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.629372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aee45-b0b9-4f91-b606-ae36687e8727 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.629665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aee45-b0b9-4f91-b606-ae36687e8727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.630018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aee45-b0b9-4f91-b606-ae36687e8727 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.632604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aee45-b0b9-4f91-b606-ae36687e8727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.636908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aee45-b0b9-4f91-b606-ae36687e8727 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.637954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 803/1622] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:38.639221 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa58f69-e9a9-4a98-ac98-d42680cfed01 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.666792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 820/1623] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:38.666792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aee45-b0b9-4f91-b606-ae36687e8727 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.694242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa58f69-e9a9-4a98-ac98-d42680cfed01 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.703170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee6ec-f65a-4e18-b83b-4286fc973836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.704210 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee6ec-f65a-4e18-b83b-4286fc973836 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.704844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee6ec-f65a-4e18-b83b-4286fc973836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.705353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee6ec-f65a-4e18-b83b-4286fc973836 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.706265 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ee6ec-f65a-4e18-b83b-4286fc973836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.706627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aee45-b0b9-4f91-b606-ae36687e8727 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.711634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ee6ec-f65a-4e18-b83b-4286fc973836 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.718489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b128d8-87cb-4ef5-a6c8-9f7721993ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.718895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b128d8-87cb-4ef5-a6c8-9f7721993ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.719178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b128d8-87cb-4ef5-a6c8-9f7721993ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.719825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b128d8-87cb-4ef5-a6c8-9f7721993ce5 admin admin] PATH_INFO: `/v3/projects/22ea7e95ab024b8ca5274e768598e674/users/b7375aca0d4b4b06965126a748a9bad7/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.757845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 804/1624] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:38 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:38.759300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee6ec-f65a-4e18-b83b-4286fc973836 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.765729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b128d8-87cb-4ef5-a6c8-9f7721993ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ea7e95ab024b8ca5274e768598e674, user_id=b7375aca0d4b4b06965126a748a9bad7, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.769689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b128d8-87cb-4ef5-a6c8-9f7721993ce5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.777399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee6ec-f65a-4e18-b83b-4286fc973836 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.787073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786d294-01f9-4951-8dc4-8d2d8a261e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.788962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786d294-01f9-4951-8dc4-8d2d8a261e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.789397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786d294-01f9-4951-8dc4-8d2d8a261e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.789792 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786d294-01f9-4951-8dc4-8d2d8a261e6e admin admin] PATH_INFO: `/v3/projects/f3d0afd3173b43a0845a62b2f6b3e6ad/users/693e2b487ead4516b8ae29dd8bfc6ab3/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.805465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 821/1625] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:38 2022] PUT /identity/v3/projects/22ea7e95ab024b8ca5274e768598e674/users/b7375aca0d4b4b06965126a748a9bad7/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:38.809970 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786d294-01f9-4951-8dc4-8d2d8a261e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d0afd3173b43a0845a62b2f6b3e6ad, user_id=693e2b487ead4516b8ae29dd8bfc6ab3, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.813056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786d294-01f9-4951-8dc4-8d2d8a261e6e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.814742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b128d8-87cb-4ef5-a6c8-9f7721993ce5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.844060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 805/1626] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:38 2022] PUT /identity/v3/projects/f3d0afd3173b43a0845a62b2f6b3e6ad/users/693e2b487ead4516b8ae29dd8bfc6ab3/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:38.845042 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786d294-01f9-4951-8dc4-8d2d8a261e6e admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:38.903033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b128d8-87cb-4ef5-a6c8-9f7721993ce5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.960433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786d294-01f9-4951-8dc4-8d2d8a261e6e admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:38.966513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0d815-5152-4d04-9f27-1ba3a9baf207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:38.967587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0d815-5152-4d04-9f27-1ba3a9baf207 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:38.968092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0d815-5152-4d04-9f27-1ba3a9baf207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:38.968607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0d815-5152-4d04-9f27-1ba3a9baf207 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:38.969630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0d815-5152-4d04-9f27-1ba3a9baf207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:38.971608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0d815-5152-4d04-9f27-1ba3a9baf207 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:38.984946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 806/1627] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:38.986280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0d815-5152-4d04-9f27-1ba3a9baf207 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:39.022457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0d815-5152-4d04-9f27-1ba3a9baf207 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:39.050530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5475b97-a257-4dd6-9f4f-62f83075081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:39.051888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475b97-a257-4dd6-9f4f-62f83075081c admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.051888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475b97-a257-4dd6-9f4f-62f83075081c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.054565 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475b97-a257-4dd6-9f4f-62f83075081c admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.056243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5475b97-a257-4dd6-9f4f-62f83075081c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:39.059019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5475b97-a257-4dd6-9f4f-62f83075081c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:39.083544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 807/1628] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:39.084379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5475b97-a257-4dd6-9f4f-62f83075081c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:39.099267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5475b97-a257-4dd6-9f4f-62f83075081c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:39.108939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350a38d-bb8b-4d17-87e0-a57db73f1aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:39.110400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dad19e-4a16-4022-aeeb-f6c618b0b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:39.111295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a38d-bb8b-4d17-87e0-a57db73f1aac admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.111433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dad19e-4a16-4022-aeeb-f6c618b0b932 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.111708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dad19e-4a16-4022-aeeb-f6c618b0b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.112446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dad19e-4a16-4022-aeeb-f6c618b0b932 admin admin] PATH_INFO: `/v3/projects/22ea7e95ab024b8ca5274e768598e674/users/b7375aca0d4b4b06965126a748a9bad7/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.112973 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a38d-bb8b-4d17-87e0-a57db73f1aac admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.114058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350a38d-bb8b-4d17-87e0-a57db73f1aac admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.114751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dad19e-4a16-4022-aeeb-f6c618b0b932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ea7e95ab024b8ca5274e768598e674, user_id=b7375aca0d4b4b06965126a748a9bad7, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:39.116118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350a38d-bb8b-4d17-87e0-a57db73f1aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:39.119430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dad19e-4a16-4022-aeeb-f6c618b0b932 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:39.120142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350a38d-bb8b-4d17-87e0-a57db73f1aac admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:39.143424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 808/1629] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:39 2022] PUT /identity/v3/projects/22ea7e95ab024b8ca5274e768598e674/users/b7375aca0d4b4b06965126a748a9bad7/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:39.143424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dad19e-4a16-4022-aeeb-f6c618b0b932 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:39.159227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 822/1630] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:39.159227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8647a9a-609f-45e6-95b9-db2db01b4278 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.164772 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8647a9a-609f-45e6-95b9-db2db01b4278 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.164905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8647a9a-609f-45e6-95b9-db2db01b4278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.206279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f8647a9a-609f-45e6-95b9-db2db01b4278 None None] MFA Rules not processed for user `b7375aca0d4b4b06965126a748a9bad7`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:39.207690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f8647a9a-609f-45e6-95b9-db2db01b4278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:39.256862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dad19e-4a16-4022-aeeb-f6c618b0b932 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:39.269430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62daa4-b8ab-4506-b8ad-531e05a7acad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:39.271000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62daa4-b8ab-4506-b8ad-531e05a7acad admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.271000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62daa4-b8ab-4506-b8ad-531e05a7acad admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.271000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62daa4-b8ab-4506-b8ad-531e05a7acad admin admin] PATH_INFO: `/v3/projects/f3d0afd3173b43a0845a62b2f6b3e6ad/users/693e2b487ead4516b8ae29dd8bfc6ab3/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.273865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62daa4-b8ab-4506-b8ad-531e05a7acad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d0afd3173b43a0845a62b2f6b3e6ad, user_id=693e2b487ead4516b8ae29dd8bfc6ab3, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:39.277701 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62daa4-b8ab-4506-b8ad-531e05a7acad admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:39.304346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 809/1631] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:39 2022] PUT /identity/v3/projects/f3d0afd3173b43a0845a62b2f6b3e6ad/users/693e2b487ead4516b8ae29dd8bfc6ab3/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:39.305377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62daa4-b8ab-4506-b8ad-531e05a7acad admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:39.365186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 823/1632] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:39.368121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce96d80-e786-4537-b120-52d2ba9a913f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.368602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce96d80-e786-4537-b120-52d2ba9a913f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.369141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce96d80-e786-4537-b120-52d2ba9a913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.402700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62daa4-b8ab-4506-b8ad-531e05a7acad admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:39.403556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-9ce96d80-e786-4537-b120-52d2ba9a913f None None] MFA Rules not processed for user `693e2b487ead4516b8ae29dd8bfc6ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:39.405877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9ce96d80-e786-4537-b120-52d2ba9a913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:39.408484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b6dbb-f8be-474a-b69e-ce58f71f13fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:39.409480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b6dbb-f8be-474a-b69e-ce58f71f13fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.409787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b6dbb-f8be-474a-b69e-ce58f71f13fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.410153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b6dbb-f8be-474a-b69e-ce58f71f13fb admin admin] PATH_INFO: `/v3/projects/f99d3f5604d9457da7fc306ad75c36a4/users/82295aa3b2a04be588a60c3538b34e34/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.442841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b6dbb-f8be-474a-b69e-ce58f71f13fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99d3f5604d9457da7fc306ad75c36a4, user_id=82295aa3b2a04be588a60c3538b34e34, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:39.449534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b6dbb-f8be-474a-b69e-ce58f71f13fb admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:39.477965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 810/1633] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:39 2022] PUT /identity/v3/projects/f99d3f5604d9457da7fc306ad75c36a4/users/82295aa3b2a04be588a60c3538b34e34/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:39.479270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b6dbb-f8be-474a-b69e-ce58f71f13fb admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:39.563092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 824/1634] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:39.563721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce96d80-e786-4537-b120-52d2ba9a913f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:39.581765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b6dbb-f8be-474a-b69e-ce58f71f13fb admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:39.588414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce96d80-e786-4537-b120-52d2ba9a913f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:39.591415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0f411a-4c70-42cd-acc7-b0bb1001663c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:39.592257 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f411a-4c70-42cd-acc7-b0bb1001663c service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.592818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f411a-4c70-42cd-acc7-b0bb1001663c service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.593486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f411a-4c70-42cd-acc7-b0bb1001663c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.731783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a5e37-f700-4049-b86c-f42e42e6c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:39.732299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a5e37-f700-4049-b86c-f42e42e6c2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.732585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a5e37-f700-4049-b86c-f42e42e6c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.732863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a5e37-f700-4049-b86c-f42e42e6c2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.733588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a5e37-f700-4049-b86c-f42e42e6c2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:39.735232 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a5e37-f700-4049-b86c-f42e42e6c2c0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:39.759542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 825/1635] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:39.759542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a5e37-f700-4049-b86c-f42e42e6c2c0 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:39.773132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f411a-4c70-42cd-acc7-b0bb1001663c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:39.777307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0f411a-4c70-42cd-acc7-b0bb1001663c service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:39.784595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a5e37-f700-4049-b86c-f42e42e6c2c0 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:39.796190 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622031ec-2a04-473d-85e7-39a728f13946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:39.796874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622031ec-2a04-473d-85e7-39a728f13946 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.797161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622031ec-2a04-473d-85e7-39a728f13946 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.797456 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622031ec-2a04-473d-85e7-39a728f13946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.811353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 811/1636] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:39.812916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deefbd-9632-44fa-b8f2-dffa06048303 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:39.814354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deefbd-9632-44fa-b8f2-dffa06048303 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:39.815945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deefbd-9632-44fa-b8f2-dffa06048303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:39.894035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-19deefbd-9632-44fa-b8f2-dffa06048303 None None] MFA Rules not processed for user `bdc08edc0e354ea0b8e41a2d81f3d9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:39.896433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-19deefbd-9632-44fa-b8f2-dffa06048303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:39.957695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622031ec-2a04-473d-85e7-39a728f13946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:39.961505 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622031ec-2a04-473d-85e7-39a728f13946 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:39.986020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 826/1637] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:39.988289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622031ec-2a04-473d-85e7-39a728f13946 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:40.009566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622031ec-2a04-473d-85e7-39a728f13946 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:40.024385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5031e7-c867-46fc-8fd4-dbde9a1fab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:40.025344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5031e7-c867-46fc-8fd4-dbde9a1fab9d admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:40.025634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5031e7-c867-46fc-8fd4-dbde9a1fab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:40.025908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5031e7-c867-46fc-8fd4-dbde9a1fab9d admin admin] PATH_INFO: `/v3/projects/f99d3f5604d9457da7fc306ad75c36a4/users/82295aa3b2a04be588a60c3538b34e34/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:40.029511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5031e7-c867-46fc-8fd4-dbde9a1fab9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99d3f5604d9457da7fc306ad75c36a4, user_id=82295aa3b2a04be588a60c3538b34e34, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:40.034720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5031e7-c867-46fc-8fd4-dbde9a1fab9d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:40.064007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 827/1638] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:39 2022] PUT /identity/v3/projects/f99d3f5604d9457da7fc306ad75c36a4/users/82295aa3b2a04be588a60c3538b34e34/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:40.064897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5031e7-c867-46fc-8fd4-dbde9a1fab9d admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:40.096618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 812/1639] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:40.097818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee965f-4e33-4962-ab71-4ac66c5421e2 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:40.098688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee965f-4e33-4962-ab71-4ac66c5421e2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:40.099360 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee965f-4e33-4962-ab71-4ac66c5421e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:40.172263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5031e7-c867-46fc-8fd4-dbde9a1fab9d admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:40.187864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:40.192324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:40.193682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:40.197086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] PATH_INFO: `/v3/users/837b3d8924b24bec9dd06efaa19fd045` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:40.199644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=837b3d8924b24bec9dd06efaa19fd045)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:40.203649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: WARNING py.warnings [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:25:40.203649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: warnings.warn(msg) Apr 12 00:25:40.203649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: Apr 12 00:25:40.208603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:40.219271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2fee965f-4e33-4962-ab71-4ac66c5421e2 None None] MFA Rules not processed for user `82295aa3b2a04be588a60c3538b34e34`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:40.221029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2fee965f-4e33-4962-ab71-4ac66c5421e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:40.393202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837b3d8924b24bec9dd06efaa19fd045'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:40.409281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837b3d8924b24bec9dd06efaa19fd045'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:40.423248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837b3d8924b24bec9dd06efaa19fd045'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:40.424289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837b3d8924b24bec9dd06efaa19fd045'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:40.425363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837b3d8924b24bec9dd06efaa19fd045'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:40.475558 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 813/1640] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:40 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:40.476871 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7689bd8-78a2-4d13-9509-0fb8d8bcbec8 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:40.477158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7689bd8-78a2-4d13-9509-0fb8d8bcbec8 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:40.477431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7689bd8-78a2-4d13-9509-0fb8d8bcbec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:40.491727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 828/1641] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:25:40 2022] DELETE /identity/v3/users/837b3d8924b24bec9dd06efaa19fd045 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:40.492834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:40.496044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:40.527398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c7689bd8-78a2-4d13-9509-0fb8d8bcbec8 None None] MFA Rules not processed for user `bdc08edc0e354ea0b8e41a2d81f3d9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:40.531537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c7689bd8-78a2-4d13-9509-0fb8d8bcbec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:40.621053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa91848-6ad6-4140-8097-de256a9e4d3c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:40.632543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660595c-28e2-498b-9239-00ce2250edc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:40.633421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660595c-28e2-498b-9239-00ce2250edc7 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:40.633806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660595c-28e2-498b-9239-00ce2250edc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:40.635013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660595c-28e2-498b-9239-00ce2250edc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:40.675171 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 814/1642] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:40.681063 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f736e4-219f-42fe-9317-fc39081e1721 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:40.681578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f736e4-219f-42fe-9317-fc39081e1721 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:40.682722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f736e4-219f-42fe-9317-fc39081e1721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:40.721113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-32f736e4-219f-42fe-9317-fc39081e1721 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:40.724035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-32f736e4-219f-42fe-9317-fc39081e1721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:40.802632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660595c-28e2-498b-9239-00ce2250edc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:40.810702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660595c-28e2-498b-9239-00ce2250edc7 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:40.863658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 829/1643] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:40 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:40.866737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c872-fee2-4a26-8156-fce8060f53ba None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:40.867011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c872-fee2-4a26-8156-fce8060f53ba None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:40.867292 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c872-fee2-4a26-8156-fce8060f53ba None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:40.874739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 830/1644] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 00:25:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:25:40.876693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fda96f-de33-476a-af7f-b4101372dfb8 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:40.877922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fda96f-de33-476a-af7f-b4101372dfb8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:40.878452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fda96f-de33-476a-af7f-b4101372dfb8 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:40.880659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 831/1645] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 00:25:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:25:40.882410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fda96f-de33-476a-af7f-b4101372dfb8 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:40.885589 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-33fda96f-de33-476a-af7f-b4101372dfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:40.921056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 815/1646] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:40.922385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c95a-8220-4855-a3f0-33503677a972 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:40.922722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c95a-8220-4855-a3f0-33503677a972 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:40.923004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744c95a-8220-4855-a3f0-33503677a972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:40.967504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d744c95a-8220-4855-a3f0-33503677a972 None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:40.968752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d744c95a-8220-4855-a3f0-33503677a972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.067459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fda96f-de33-476a-af7f-b4101372dfb8 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:41.087537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:41.089685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:41.089977 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:41.091230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] PATH_INFO: `/v3/users/8826856e447c4db78780cef1ce5729d8` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:41.094148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8826856e447c4db78780cef1ce5729d8)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:41.099104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:41.110065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 816/1647] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 00:25:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:41.111696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98986f68-fe61-4119-8221-036fffcb8286 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:41.112142 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98986f68-fe61-4119-8221-036fffcb8286 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:41.114336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98986f68-fe61-4119-8221-036fffcb8286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:41.155304 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-98986f68-fe61-4119-8221-036fffcb8286 None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:41.156776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-98986f68-fe61-4119-8221-036fffcb8286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.172242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8826856e447c4db78780cef1ce5729d8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:41.182597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8826856e447c4db78780cef1ce5729d8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:41.192290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 817/1648] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 00:25:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:41.194050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98986f68-fe61-4119-8221-036fffcb8286 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:41.199708 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8826856e447c4db78780cef1ce5729d8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:41.199963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-98986f68-fe61-4119-8221-036fffcb8286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.201127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8826856e447c4db78780cef1ce5729d8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:41.202790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8826856e447c4db78780cef1ce5729d8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:41.239629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 832/1649] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:25:40 2022] DELETE /identity/v3/users/8826856e447c4db78780cef1ce5729d8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:41.241775 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:41.243530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.331706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98986f68-fe61-4119-8221-036fffcb8286 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:41.390477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faec1ab-31a5-445a-9602-c820da624d1f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:41.401593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dff40f-a5d7-479a-8529-124862ce8ffb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:41.403354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dff40f-a5d7-479a-8529-124862ce8ffb service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:41.405132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dff40f-a5d7-479a-8529-124862ce8ffb service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:41.406771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dff40f-a5d7-479a-8529-124862ce8ffb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:41.412985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d9dff40f-a5d7-479a-8529-124862ce8ffb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.451924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c3cee-f6ce-4582-96d7-5c261f8eccc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:41.452591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c3cee-f6ce-4582-96d7-5c261f8eccc1 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:41.452871 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c3cee-f6ce-4582-96d7-5c261f8eccc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:41.453144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c3cee-f6ce-4582-96d7-5c261f8eccc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:41.463873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ae9c3cee-f6ce-4582-96d7-5c261f8eccc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.512229 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dff40f-a5d7-479a-8529-124862ce8ffb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:41.513810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dff40f-a5d7-479a-8529-124862ce8ffb service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:41.525839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 833/1650] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:41 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:41.545242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adab61d-d04c-4a8f-808b-c58b8d6bf157 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:41.549796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adab61d-d04c-4a8f-808b-c58b8d6bf157 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:41.551735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adab61d-d04c-4a8f-808b-c58b8d6bf157 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:41.555303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 834/1651] 10.222.0.32 () {54 vars in 912 bytes} [Tue Apr 12 00:25:41 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:25:41.557262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adab61d-d04c-4a8f-808b-c58b8d6bf157 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:41.561553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1adab61d-d04c-4a8f-808b-c58b8d6bf157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.600771 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c3cee-f6ce-4582-96d7-5c261f8eccc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:41.602232 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c3cee-f6ce-4582-96d7-5c261f8eccc1 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:41.622155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 818/1652] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:41.623541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66b398-72b3-4870-9f18-a97adc84c76f None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:41.623831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66b398-72b3-4870-9f18-a97adc84c76f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:41.624224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66b398-72b3-4870-9f18-a97adc84c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:41.650636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2e66b398-72b3-4870-9f18-a97adc84c76f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:41.652529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2e66b398-72b3-4870-9f18-a97adc84c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.683802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 819/1653] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:41.690571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdada217-ee90-4fdc-ace1-622a5b25d999 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:41.690869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdada217-ee90-4fdc-ace1-622a5b25d999 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:41.691149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdada217-ee90-4fdc-ace1-622a5b25d999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:41.739451 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fdada217-ee90-4fdc-ace1-622a5b25d999 None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:41.740765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fdada217-ee90-4fdc-ace1-622a5b25d999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.798067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adab61d-d04c-4a8f-808b-c58b8d6bf157 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:41.813843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6bc5a-587f-4f82-a5f1-4851ad45603e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:41.815702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6bc5a-587f-4f82-a5f1-4851ad45603e service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:41.815989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6bc5a-587f-4f82-a5f1-4851ad45603e service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:41.816271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6bc5a-587f-4f82-a5f1-4851ad45603e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:41.821364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ebe6bc5a-587f-4f82-a5f1-4851ad45603e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.961195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6bc5a-587f-4f82-a5f1-4851ad45603e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:41.962599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 820/1654] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:25:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:41.963762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdada217-ee90-4fdc-ace1-622a5b25d999 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:41.965501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fdada217-ee90-4fdc-ace1-622a5b25d999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:41.979573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6bc5a-587f-4f82-a5f1-4851ad45603e service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:42.002773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdada217-ee90-4fdc-ace1-622a5b25d999 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:42.011706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 835/1655] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:42.012539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9398d45-f32f-46b2-80d3-d338b08f9989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:42.013207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398d45-f32f-46b2-80d3-d338b08f9989 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:42.013488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398d45-f32f-46b2-80d3-d338b08f9989 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:42.018358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9398d45-f32f-46b2-80d3-d338b08f9989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:42.025857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6bc5a-587f-4f82-a5f1-4851ad45603e service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:42.035977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398d45-f32f-46b2-80d3-d338b08f9989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:42.037969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9398d45-f32f-46b2-80d3-d338b08f9989 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:42.046834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6bc5a-587f-4f82-a5f1-4851ad45603e service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:42.057828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f66497-b944-4f33-8125-21a763629968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:42.060282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 821/1656] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:42.060430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f66497-b944-4f33-8125-21a763629968 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:42.060530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f66497-b944-4f33-8125-21a763629968 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:42.060741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f66497-b944-4f33-8125-21a763629968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:42.086110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f66497-b944-4f33-8125-21a763629968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:42.091868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f66497-b944-4f33-8125-21a763629968 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:42.115747 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 836/1657] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:42.490043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd71cff-b734-465b-92d2-f897dc04d549 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:42.491383 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd71cff-b734-465b-92d2-f897dc04d549 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:42.491728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd71cff-b734-465b-92d2-f897dc04d549 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:42.494116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 822/1658] 10.222.0.32 () {54 vars in 912 bytes} [Tue Apr 12 00:25:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:25:42.500354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d414d9-973b-441e-820f-055375921cce None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:42.500885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d414d9-973b-441e-820f-055375921cce None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:42.500998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d414d9-973b-441e-820f-055375921cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:42.538315 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e2d414d9-973b-441e-820f-055375921cce None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:42.542290 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e2d414d9-973b-441e-820f-055375921cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:42.566621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 837/1659] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:25:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:42.583791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd71cff-b734-465b-92d2-f897dc04d549 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:42.586394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-cbd71cff-b734-465b-92d2-f897dc04d549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:42.720491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd71cff-b734-465b-92d2-f897dc04d549 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:42.729361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe563efd-8d91-4120-bb7c-dff09e62ae67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaf01f45e7a429e9361eb176a3f7c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:42.731098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe563efd-8d91-4120-bb7c-dff09e62ae67 service glance] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:42.731497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe563efd-8d91-4120-bb7c-dff09e62ae67 service glance] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:42.731887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe563efd-8d91-4120-bb7c-dff09e62ae67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:42.755442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe563efd-8d91-4120-bb7c-dff09e62ae67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:42.763025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe563efd-8d91-4120-bb7c-dff09e62ae67 service glance] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:42.789298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 823/1660] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:44.062145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d414d9-973b-441e-820f-055375921cce None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:44.066403 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e2d414d9-973b-441e-820f-055375921cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:44.098648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d414d9-973b-441e-820f-055375921cce None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:44.111830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:44.112970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:44.113479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:44.113979 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] PATH_INFO: `/v3/projects/587761ad1ee449b783e09cd1ae3fc3ae` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:44.116367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] RBAC: Authorizing `identity:delete_project(project_id=587761ad1ee449b783e09cd1ae3fc3ae)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:44.119312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:44.232050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be9a7b-c8bb-4b3b-9241-e25211241de1 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:44.233069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be9a7b-c8bb-4b3b-9241-e25211241de1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:44.233573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be9a7b-c8bb-4b3b-9241-e25211241de1 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:44.236244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 824/1661] 10.222.0.32 () {54 vars in 912 bytes} [Tue Apr 12 00:25:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:25:44.246275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4ab1-6946-4e3c-86a8-26f1ef0f6625 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:44.247518 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4ab1-6946-4e3c-86a8-26f1ef0f6625 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:44.248022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4ab1-6946-4e3c-86a8-26f1ef0f6625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:44.262178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '587761ad1ee449b783e09cd1ae3fc3ae', 'request_id': 'req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.278181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '587761ad1ee449b783e09cd1ae3fc3ae', 'request_id': 'req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.302025 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '587761ad1ee449b783e09cd1ae3fc3ae', 'request_id': 'req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.367771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] The token cache is being invalidate because project 587761ad1ee449b783e09cd1ae3fc3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:25:44.368080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.368792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.373376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 838/1662] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:25:44 2022] DELETE /identity/v3/projects/587761ad1ee449b783e09cd1ae3fc3ae => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:44.373376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:44.376118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:44.423314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ae8e4ab1-6946-4e3c-86a8-26f1ef0f6625 None None] MFA Rules not processed for user `a99a9951d83446efbf819b72836afc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:44.424534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ae8e4ab1-6946-4e3c-86a8-26f1ef0f6625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:44.560321 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68f95-a90a-4fd6-bf92-f21a9e7feadd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:44.580538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:44.581430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:44.581715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:44.581991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] PATH_INFO: `/v3/projects/fbac78e6502d4aa7a1d7d9799921c917` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:44.587126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbac78e6502d4aa7a1d7d9799921c917)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:44.589081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:44.601983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 825/1663] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:25:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:25:44.603012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e4ab1-6946-4e3c-86a8-26f1ef0f6625 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:44.604957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ae8e4ab1-6946-4e3c-86a8-26f1ef0f6625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:44.640240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e4ab1-6946-4e3c-86a8-26f1ef0f6625 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:44.653469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:44.654672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:44.655323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:44.655609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] PATH_INFO: `/v3/users/693e2b487ead4516b8ae29dd8bfc6ab3` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:44.660122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] RBAC: Authorizing `identity:delete_user(user_id=693e2b487ead4516b8ae29dd8bfc6ab3)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:44.662147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:44.769206 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbac78e6502d4aa7a1d7d9799921c917', 'request_id': 'req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.778883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693e2b487ead4516b8ae29dd8bfc6ab3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.788884 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbac78e6502d4aa7a1d7d9799921c917', 'request_id': 'req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.798093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbac78e6502d4aa7a1d7d9799921c917', 'request_id': 'req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.812525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693e2b487ead4516b8ae29dd8bfc6ab3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.840308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] The token cache is being invalidate because project fbac78e6502d4aa7a1d7d9799921c917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:25:44.840308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.842847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.843997 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693e2b487ead4516b8ae29dd8bfc6ab3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.845175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693e2b487ead4516b8ae29dd8bfc6ab3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.846067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693e2b487ead4516b8ae29dd8bfc6ab3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:44.852051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 839/1664] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:25:44 2022] DELETE /identity/v3/projects/fbac78e6502d4aa7a1d7d9799921c917 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:44.852494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:44.863247 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:44.920803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 826/1665] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:25:44 2022] DELETE /identity/v3/users/693e2b487ead4516b8ae29dd8bfc6ab3 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:44.924336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:44.932872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:45.071576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada21d-9ee3-4e02-8cbe-33952f5a2605 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:45.220681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a72b740-a5de-4485-b9d4-cf973d1479e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:45.222183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72b740-a5de-4485-b9d4-cf973d1479e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:45.222741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72b740-a5de-4485-b9d4-cf973d1479e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:45.223233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72b740-a5de-4485-b9d4-cf973d1479e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:45.232498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d48f4-7b8a-4b6e-82b6-42cde08b875f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:45.234627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2a72b740-a5de-4485-b9d4-cf973d1479e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:45.253632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:45.254562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:45.254846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:45.255119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] PATH_INFO: `/v3/users/b7375aca0d4b4b06965126a748a9bad7` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:45.262177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7375aca0d4b4b06965126a748a9bad7)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:45.264172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:45.274651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72b740-a5de-4485-b9d4-cf973d1479e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:45.281106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a72b740-a5de-4485-b9d4-cf973d1479e6 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:45.309981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 840/1666] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:45.436122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7375aca0d4b4b06965126a748a9bad7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:45.469798 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7375aca0d4b4b06965126a748a9bad7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:45.497208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7375aca0d4b4b06965126a748a9bad7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:45.497922 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7375aca0d4b4b06965126a748a9bad7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:45.498608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-32cefe63-80c3-4bce-81b4-6000b3a08032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7375aca0d4b4b06965126a748a9bad7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:45.538438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 827/1667] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:25:44 2022] DELETE /identity/v3/users/b7375aca0d4b4b06965126a748a9bad7 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:46.610381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e960e4-5b3d-40f6-aabb-45c2224b6958 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:46.610886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e960e4-5b3d-40f6-aabb-45c2224b6958 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:46.610963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e960e4-5b3d-40f6-aabb-45c2224b6958 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:46.614899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 841/1668] 10.222.0.32 () {54 vars in 960 bytes} [Tue Apr 12 00:25:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:25:46.625200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f375f-a6a8-4433-a741-e3be41ab8f71 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:46.625723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f375f-a6a8-4433-a741-e3be41ab8f71 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:46.626165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f375f-a6a8-4433-a741-e3be41ab8f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:46.649589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5f7f375f-a6a8-4433-a741-e3be41ab8f71 None None] MFA Rules not processed for user `92588782f32a472193340aba2bff8d78`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:46.651029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5f7f375f-a6a8-4433-a741-e3be41ab8f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:46.810857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 828/1669] 10.222.0.32 () {58 vars in 1057 bytes} [Tue Apr 12 00:25:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:46.819495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e960e4-5b3d-40f6-aabb-45c2224b6958 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:46.870806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e960e4-5b3d-40f6-aabb-45c2224b6958 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:46.885573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92588782f32a472193340aba2bff8d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:46.886294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:46.886614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:46.886902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:46.896257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:46.938673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:46.942569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:46.973054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 842/1670] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:47.075057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f375f-a6a8-4433-a741-e3be41ab8f71 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:47.077541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5f7f375f-a6a8-4433-a741-e3be41ab8f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:47.155595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:47.157051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:47.257815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f375f-a6a8-4433-a741-e3be41ab8f71 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:47.277414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:47.280082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:47.280845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:47.282177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] PATH_INFO: `/v3/projects/22ea7e95ab024b8ca5274e768598e674` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:47.287971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ea7e95ab024b8ca5274e768598e674)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:47.293603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: WARNING py.warnings [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:25:47.293603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: warnings.warn(msg) Apr 12 00:25:47.293603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: Apr 12 00:25:47.299332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:47.407102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8e3d9-adc3-479d-8d8e-4e86e9511dd6 service placement] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:47.465749 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ea7e95ab024b8ca5274e768598e674', 'request_id': 'req-42641dbb-1702-4e94-8889-4efe77d6f33d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.503760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ea7e95ab024b8ca5274e768598e674', 'request_id': 'req-42641dbb-1702-4e94-8889-4efe77d6f33d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.511607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:47.512709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:47.513134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:47.515507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] PATH_INFO: `/v3/projects/f3d0afd3173b43a0845a62b2f6b3e6ad` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:47.519060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d0afd3173b43a0845a62b2f6b3e6ad)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:47.521189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:47.529715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ea7e95ab024b8ca5274e768598e674', 'request_id': 'req-42641dbb-1702-4e94-8889-4efe77d6f33d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.555467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] The token cache is being invalidate because project 22ea7e95ab024b8ca5274e768598e674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:25:47.555920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.558607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-42641dbb-1702-4e94-8889-4efe77d6f33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.565882 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 829/1671] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:25:47 2022] DELETE /identity/v3/projects/22ea7e95ab024b8ca5274e768598e674 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:47.568091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061847-1086-4bfc-b3a1-6176bf475822 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:47.568582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061847-1086-4bfc-b3a1-6176bf475822 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:47.569021 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061847-1086-4bfc-b3a1-6176bf475822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:47.617449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-4d061847-1086-4bfc-b3a1-6176bf475822 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:47.618914 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4d061847-1086-4bfc-b3a1-6176bf475822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:47.662049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d0afd3173b43a0845a62b2f6b3e6ad', 'request_id': 'req-35b305e8-2487-4f5c-997a-ea1f65e27ece'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.696571 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d0afd3173b43a0845a62b2f6b3e6ad', 'request_id': 'req-35b305e8-2487-4f5c-997a-ea1f65e27ece'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.707854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d0afd3173b43a0845a62b2f6b3e6ad', 'request_id': 'req-35b305e8-2487-4f5c-997a-ea1f65e27ece'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.732841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] The token cache is being invalidate because project f3d0afd3173b43a0845a62b2f6b3e6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:25:47.738165 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.741386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-35b305e8-2487-4f5c-997a-ea1f65e27ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:47.743868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 843/1672] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:25:47 2022] DELETE /identity/v3/projects/f3d0afd3173b43a0845a62b2f6b3e6ad => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:25:47.748817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8113-82a9-41eb-a30b-810cd928d596 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:47.749479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8113-82a9-41eb-a30b-810cd928d596 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:47.749932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f8113-82a9-41eb-a30b-810cd928d596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:47.805118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 830/1673] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:47.806704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a98f8113-82a9-41eb-a30b-810cd928d596 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:47.811468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a98f8113-82a9-41eb-a30b-810cd928d596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:47.813382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe7f8b-c084-40ea-9909-f77e7fdea9ca None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:47.813848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe7f8b-c084-40ea-9909-f77e7fdea9ca None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:47.814704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe7f8b-c084-40ea-9909-f77e7fdea9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:47.858153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 844/1674] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:47.859848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44135528-cdd6-4ae6-934f-0571de976c91 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:47.860287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44135528-cdd6-4ae6-934f-0571de976c91 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:47.860706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44135528-cdd6-4ae6-934f-0571de976c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:47.880224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-effe7f8b-c084-40ea-9909-f77e7fdea9ca None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:47.885376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-effe7f8b-c084-40ea-9909-f77e7fdea9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:47.931635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-44135528-cdd6-4ae6-934f-0571de976c91 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:47.932859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-44135528-cdd6-4ae6-934f-0571de976c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:47.935379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 831/1675] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:25:47.947093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe7f8b-c084-40ea-9909-f77e7fdea9ca None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:47.962546 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe7f8b-c084-40ea-9909-f77e7fdea9ca None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:47.967685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 845/1676] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:47.969708 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44135528-cdd6-4ae6-934f-0571de976c91 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:47.993578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905dc11-8f0a-4ea8-ac91-2e74d0269917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:47.994299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905dc11-8f0a-4ea8-ac91-2e74d0269917 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:47.994568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905dc11-8f0a-4ea8-ac91-2e74d0269917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:47.994844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c905dc11-8f0a-4ea8-ac91-2e74d0269917 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:47.995588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905dc11-8f0a-4ea8-ac91-2e74d0269917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:47.995894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905dc11-8f0a-4ea8-ac91-2e74d0269917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:47.997545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c905dc11-8f0a-4ea8-ac91-2e74d0269917 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.003512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44135528-cdd6-4ae6-934f-0571de976c91 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.023481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bac9b-c032-455e-b6c2-633dd2fd7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.026807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bac9b-c032-455e-b6c2-633dd2fd7c48 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.027345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bac9b-c032-455e-b6c2-633dd2fd7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.032260 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bac9b-c032-455e-b6c2-633dd2fd7c48 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.036771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bac9b-c032-455e-b6c2-633dd2fd7c48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:48.037900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bac9b-c032-455e-b6c2-633dd2fd7c48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.039757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13bac9b-c032-455e-b6c2-633dd2fd7c48 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.045895 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 832/1677] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:25:48.051575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905dc11-8f0a-4ea8-ac91-2e74d0269917 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.086202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c905dc11-8f0a-4ea8-ac91-2e74d0269917 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.089170 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 846/1678] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:25:48.090364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bac9b-c032-455e-b6c2-633dd2fd7c48 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.105471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad313f9-219c-497f-acfb-0c4b82f3b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.106350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad313f9-219c-497f-acfb-0c4b82f3b8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.106774 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad313f9-219c-497f-acfb-0c4b82f3b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.107214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad313f9-219c-497f-acfb-0c4b82f3b8f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.108059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad313f9-219c-497f-acfb-0c4b82f3b8f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.110145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad313f9-219c-497f-acfb-0c4b82f3b8f5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.112970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13bac9b-c032-455e-b6c2-633dd2fd7c48 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.126766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef1a96-62c3-44e8-bc7b-ffce120b037c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.127718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef1a96-62c3-44e8-bc7b-ffce120b037c admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.128132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef1a96-62c3-44e8-bc7b-ffce120b037c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.128542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef1a96-62c3-44e8-bc7b-ffce120b037c admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.129374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef1a96-62c3-44e8-bc7b-ffce120b037c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.131506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef1a96-62c3-44e8-bc7b-ffce120b037c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.170065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 833/1679] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:48 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:48.174395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad313f9-219c-497f-acfb-0c4b82f3b8f5 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.201047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 847/1680] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:48 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:48.202078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef1a96-62c3-44e8-bc7b-ffce120b037c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.324891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad313f9-219c-497f-acfb-0c4b82f3b8f5 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.360948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef1a96-62c3-44e8-bc7b-ffce120b037c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.384925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719b45-6536-4d4d-a98f-48e3601a00a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.386607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719b45-6536-4d4d-a98f-48e3601a00a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.387002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719b45-6536-4d4d-a98f-48e3601a00a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.387971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719b45-6536-4d4d-a98f-48e3601a00a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.390694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8719b45-6536-4d4d-a98f-48e3601a00a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.394441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8719b45-6536-4d4d-a98f-48e3601a00a4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.461478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 848/1681] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:48 2022] POST /identity/v3/users => generated 285 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:48.465716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719b45-6536-4d4d-a98f-48e3601a00a4 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.476888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5090210-af53-4846-aa7a-7154282f80ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.477589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5090210-af53-4846-aa7a-7154282f80ad admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.477903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5090210-af53-4846-aa7a-7154282f80ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.478175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5090210-af53-4846-aa7a-7154282f80ad admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.478903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5090210-af53-4846-aa7a-7154282f80ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.480850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5090210-af53-4846-aa7a-7154282f80ad admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.486885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719b45-6536-4d4d-a98f-48e3601a00a4 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.501735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770425f-3b98-4f0e-b40b-89053c2b572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.503527 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770425f-3b98-4f0e-b40b-89053c2b572c admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.503938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770425f-3b98-4f0e-b40b-89053c2b572c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.504388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770425f-3b98-4f0e-b40b-89053c2b572c admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.505434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770425f-3b98-4f0e-b40b-89053c2b572c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.507084 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770425f-3b98-4f0e-b40b-89053c2b572c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.527834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 834/1682] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:48 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:48.531519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5090210-af53-4846-aa7a-7154282f80ad admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.543915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 849/1683] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:48.545082 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770425f-3b98-4f0e-b40b-89053c2b572c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.551838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5090210-af53-4846-aa7a-7154282f80ad admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.563138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770425f-3b98-4f0e-b40b-89053c2b572c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.566039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a0e7-803c-401b-97a6-750e03ba005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.566765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a0e7-803c-401b-97a6-750e03ba005d admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.567050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a0e7-803c-401b-97a6-750e03ba005d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.567328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a0e7-803c-401b-97a6-750e03ba005d admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.568078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272a0e7-803c-401b-97a6-750e03ba005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.571757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272a0e7-803c-401b-97a6-750e03ba005d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.576275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347e34b-62dc-461f-b8bc-59dba4fe4017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.576275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e34b-62dc-461f-b8bc-59dba4fe4017 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.576496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e34b-62dc-461f-b8bc-59dba4fe4017 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.576866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347e34b-62dc-461f-b8bc-59dba4fe4017 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.589343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347e34b-62dc-461f-b8bc-59dba4fe4017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.597538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 835/1684] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:25:48.599037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347e34b-62dc-461f-b8bc-59dba4fe4017 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.599908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a0e7-803c-401b-97a6-750e03ba005d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.622652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a0e7-803c-401b-97a6-750e03ba005d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.632518 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2f6ab-1fe8-4aaa-bfe3-fbb09969a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.634793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2f6ab-1fe8-4aaa-bfe3-fbb09969a459 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.635687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2f6ab-1fe8-4aaa-bfe3-fbb09969a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.636272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2f6ab-1fe8-4aaa-bfe3-fbb09969a459 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.637516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2f6ab-1fe8-4aaa-bfe3-fbb09969a459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.640493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2f6ab-1fe8-4aaa-bfe3-fbb09969a459 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.644973 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 850/1685] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:48.648468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347e34b-62dc-461f-b8bc-59dba4fe4017 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.677803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 836/1686] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:48.681557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2f6ab-1fe8-4aaa-bfe3-fbb09969a459 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:48.686104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347e34b-62dc-461f-b8bc-59dba4fe4017 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.693066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d14d57-685f-4656-a7a7-a0d3fbd05e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.695120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d14d57-685f-4656-a7a7-a0d3fbd05e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.695576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d14d57-685f-4656-a7a7-a0d3fbd05e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.696033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d14d57-685f-4656-a7a7-a0d3fbd05e4f admin admin] PATH_INFO: `/v3/projects/0723b8c5f02843ba8d5375ad96fa51bf/users/795a5b51f28b4718ab4e009907960953/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.699573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2f6ab-1fe8-4aaa-bfe3-fbb09969a459 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:48.705702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a055308-ecb0-47de-8328-f4754ae53608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:48.708638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a055308-ecb0-47de-8328-f4754ae53608 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.711056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a055308-ecb0-47de-8328-f4754ae53608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.711681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a055308-ecb0-47de-8328-f4754ae53608 admin admin] PATH_INFO: `/v3/projects/7feba8302a674b08bd89c0aa02e8f0dc/users/027299219c51453294b69cc441e57023/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.721884 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d14d57-685f-4656-a7a7-a0d3fbd05e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0723b8c5f02843ba8d5375ad96fa51bf, user_id=795a5b51f28b4718ab4e009907960953, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.726793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d14d57-685f-4656-a7a7-a0d3fbd05e4f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.751648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 851/1687] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:48 2022] PUT /identity/v3/projects/0723b8c5f02843ba8d5375ad96fa51bf/users/795a5b51f28b4718ab4e009907960953/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:48.754737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614bf5c-abde-49b4-8803-28d75e09332b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.755526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614bf5c-abde-49b4-8803-28d75e09332b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.756583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614bf5c-abde-49b4-8803-28d75e09332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.778204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a055308-ecb0-47de-8328-f4754ae53608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7feba8302a674b08bd89c0aa02e8f0dc, user_id=027299219c51453294b69cc441e57023, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:48.781113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a055308-ecb0-47de-8328-f4754ae53608 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:48.791467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1614bf5c-abde-49b4-8803-28d75e09332b None None] MFA Rules not processed for user `f0fad81c4cbd4335967e97fd7de9963d`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:48.792989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1614bf5c-abde-49b4-8803-28d75e09332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:48.823174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 837/1688] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:48 2022] PUT /identity/v3/projects/7feba8302a674b08bd89c0aa02e8f0dc/users/027299219c51453294b69cc441e57023/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:25:48.825025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918ed7d-c3c7-405b-b9e7-c01c95d8ae95 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.827781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918ed7d-c3c7-405b-b9e7-c01c95d8ae95 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.828221 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918ed7d-c3c7-405b-b9e7-c01c95d8ae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:48.911515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0918ed7d-c3c7-405b-b9e7-c01c95d8ae95 None None] MFA Rules not processed for user `795a5b51f28b4718ab4e009907960953`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:48.913527 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0918ed7d-c3c7-405b-b9e7-c01c95d8ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:48.932457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 852/1689] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:48.949593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164022e-307b-4da9-9bee-9925d7758efa None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:48.949880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164022e-307b-4da9-9bee-9925d7758efa None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:48.950164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164022e-307b-4da9-9bee-9925d7758efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:49.130181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-8164022e-307b-4da9-9bee-9925d7758efa None None] MFA Rules not processed for user `027299219c51453294b69cc441e57023`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:49.134766 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 838/1690] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:49.141919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8164022e-307b-4da9-9bee-9925d7758efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:49.153320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918ed7d-c3c7-405b-b9e7-c01c95d8ae95 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:49.158911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0918ed7d-c3c7-405b-b9e7-c01c95d8ae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:49.362371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918ed7d-c3c7-405b-b9e7-c01c95d8ae95 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:49.374029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2f6a8-7907-4155-b864-22bd3f4d3c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:49.374835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f6a8-7907-4155-b864-22bd3f4d3c2e service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:49.375219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f6a8-7907-4155-b864-22bd3f4d3c2e service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:49.375616 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2f6a8-7907-4155-b864-22bd3f4d3c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:49.419512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 853/1691] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:49.422095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164022e-307b-4da9-9bee-9925d7758efa None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:49.538888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2f6a8-7907-4155-b864-22bd3f4d3c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:49.540653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2f6a8-7907-4155-b864-22bd3f4d3c2e service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:49.576194 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 839/1692] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:49.581476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2f6a8-7907-4155-b864-22bd3f4d3c2e service nova] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:49.719259 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164022e-307b-4da9-9bee-9925d7758efa None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:49.740788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ba478-bc09-4443-add1-5a3bacd9ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:49.741552 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ba478-bc09-4443-add1-5a3bacd9ad8c admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:49.745743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ba478-bc09-4443-add1-5a3bacd9ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:49.746637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ba478-bc09-4443-add1-5a3bacd9ad8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:49.749258 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ba478-bc09-4443-add1-5a3bacd9ad8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:49.760669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ba478-bc09-4443-add1-5a3bacd9ad8c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:49.806924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2f6a8-7907-4155-b864-22bd3f4d3c2e service nova] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:49.817699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4fd7a-6532-4004-be42-70ab8aafeb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:49.819691 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4fd7a-6532-4004-be42-70ab8aafeb95 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:49.820720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4fd7a-6532-4004-be42-70ab8aafeb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:49.821624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4fd7a-6532-4004-be42-70ab8aafeb95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:49.823941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4fd7a-6532-4004-be42-70ab8aafeb95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:49.826791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4fd7a-6532-4004-be42-70ab8aafeb95 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:49.870594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 854/1693] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:49 2022] POST /identity/v3/projects => generated 369 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:49.874789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ba478-bc09-4443-add1-5a3bacd9ad8c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:49.906153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 840/1694] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:49 2022] POST /identity/v3/projects => generated 385 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:49.910404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4fd7a-6532-4004-be42-70ab8aafeb95 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:50.051122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ba478-bc09-4443-add1-5a3bacd9ad8c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.132371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4fd7a-6532-4004-be42-70ab8aafeb95 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.154963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98cc3e-42dd-43e7-921f-aafbe3d674e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:50.155891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98cc3e-42dd-43e7-921f-aafbe3d674e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.156317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98cc3e-42dd-43e7-921f-aafbe3d674e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.156736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98cc3e-42dd-43e7-921f-aafbe3d674e3 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.157590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98cc3e-42dd-43e7-921f-aafbe3d674e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:50.163913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98cc3e-42dd-43e7-921f-aafbe3d674e3 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:50.205533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23dacf-9345-41d7-bc66-970bb40fc5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:50.206078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23dacf-9345-41d7-bc66-970bb40fc5de admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.208069 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23dacf-9345-41d7-bc66-970bb40fc5de admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.208424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23dacf-9345-41d7-bc66-970bb40fc5de admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.209202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23dacf-9345-41d7-bc66-970bb40fc5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:50.216106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23dacf-9345-41d7-bc66-970bb40fc5de admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:50.262124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 841/1695] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:49 2022] POST /identity/v3/users => generated 299 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:50.264551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98cc3e-42dd-43e7-921f-aafbe3d674e3 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:50.290937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 855/1696] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:49 2022] POST /identity/v3/users => generated 291 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:25:50.295610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23dacf-9345-41d7-bc66-970bb40fc5de admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:50.302178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98cc3e-42dd-43e7-921f-aafbe3d674e3 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.312622 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8bb21-da9c-4147-aaf1-b42316ec3951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:50.313465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8bb21-da9c-4147-aaf1-b42316ec3951 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.313783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8bb21-da9c-4147-aaf1-b42316ec3951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.314073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8bb21-da9c-4147-aaf1-b42316ec3951 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.315437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8bb21-da9c-4147-aaf1-b42316ec3951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:50.317252 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8bb21-da9c-4147-aaf1-b42316ec3951 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:50.329253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23dacf-9345-41d7-bc66-970bb40fc5de admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.336375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 842/1697] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:50.349929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8bb21-da9c-4147-aaf1-b42316ec3951 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:50.368911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23278b1-6743-4aac-9148-68043b5f974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:50.380968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23278b1-6743-4aac-9148-68043b5f974d admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.380968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23278b1-6743-4aac-9148-68043b5f974d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.380968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23278b1-6743-4aac-9148-68043b5f974d admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.382447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23278b1-6743-4aac-9148-68043b5f974d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:50.382937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8bb21-da9c-4147-aaf1-b42316ec3951 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.394483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23278b1-6743-4aac-9148-68043b5f974d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:50.399573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c75ed-cdfa-480e-b0af-de69b2762319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:50.400998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c75ed-cdfa-480e-b0af-de69b2762319 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.401541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c75ed-cdfa-480e-b0af-de69b2762319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.403666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1c75ed-cdfa-480e-b0af-de69b2762319 admin admin] PATH_INFO: `/v3/projects/0ebe6a3b0f8a4d08be8d546d3940eb74/users/419739fae3e4496382211d2d9456c782/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.436937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 856/1698] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:50.437943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23278b1-6743-4aac-9148-68043b5f974d admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:50.455269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c75ed-cdfa-480e-b0af-de69b2762319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebe6a3b0f8a4d08be8d546d3940eb74, user_id=419739fae3e4496382211d2d9456c782, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:50.458439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1c75ed-cdfa-480e-b0af-de69b2762319 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:50.477883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23278b1-6743-4aac-9148-68043b5f974d admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.497603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04008edc-203e-46c3-b99e-156b0ef38246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:50.501232 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04008edc-203e-46c3-b99e-156b0ef38246 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.501550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04008edc-203e-46c3-b99e-156b0ef38246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.501826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04008edc-203e-46c3-b99e-156b0ef38246 admin admin] PATH_INFO: `/v3/projects/d9ebc59b4c8745f2aaaaba5b0aa10ee3/users/b532f5d44b9b41b9b1c591dd895c4002/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.533688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 843/1699] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:50 2022] PUT /identity/v3/projects/0ebe6a3b0f8a4d08be8d546d3940eb74/users/419739fae3e4496382211d2d9456c782/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:50.537484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c75ed-cdfa-480e-b0af-de69b2762319 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:50.575558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04008edc-203e-46c3-b99e-156b0ef38246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ebc59b4c8745f2aaaaba5b0aa10ee3, user_id=b532f5d44b9b41b9b1c591dd895c4002, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:50.583125 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04008edc-203e-46c3-b99e-156b0ef38246 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:50.619115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 857/1700] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:50 2022] PUT /identity/v3/projects/d9ebc59b4c8745f2aaaaba5b0aa10ee3/users/b532f5d44b9b41b9b1c591dd895c4002/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:50.620633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04008edc-203e-46c3-b99e-156b0ef38246 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:50.742408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04008edc-203e-46c3-b99e-156b0ef38246 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.752666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b6a93-0903-4ab3-be35-7fe327064d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:50.753655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b6a93-0903-4ab3-be35-7fe327064d54 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.754015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b6a93-0903-4ab3-be35-7fe327064d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.754411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b6a93-0903-4ab3-be35-7fe327064d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.755222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b6a93-0903-4ab3-be35-7fe327064d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:50.756945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b6a93-0903-4ab3-be35-7fe327064d54 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:50.771778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 858/1701] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:50.772982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b6a93-0903-4ab3-be35-7fe327064d54 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:50.781442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1c75ed-cdfa-480e-b0af-de69b2762319 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.800241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b6a93-0903-4ab3-be35-7fe327064d54 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.800661 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94f6a-a14f-42c0-9cb9-791f65eb87b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:50.801475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94f6a-a14f-42c0-9cb9-791f65eb87b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.801767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94f6a-a14f-42c0-9cb9-791f65eb87b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.802043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94f6a-a14f-42c0-9cb9-791f65eb87b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.802856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94f6a-a14f-42c0-9cb9-791f65eb87b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:50.810351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94f6a-a14f-42c0-9cb9-791f65eb87b9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:50.811013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84bbd2-c549-4526-b915-cd24db299a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:50.812095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84bbd2-c549-4526-b915-cd24db299a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.812531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84bbd2-c549-4526-b915-cd24db299a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.812945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84bbd2-c549-4526-b915-cd24db299a03 admin admin] PATH_INFO: `/v3/projects/d9ebc59b4c8745f2aaaaba5b0aa10ee3/users/b532f5d44b9b41b9b1c591dd895c4002/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.816595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84bbd2-c549-4526-b915-cd24db299a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ebc59b4c8745f2aaaaba5b0aa10ee3, user_id=b532f5d44b9b41b9b1c591dd895c4002, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:50.821465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84bbd2-c549-4526-b915-cd24db299a03 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:50.838226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 859/1702] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:50 2022] PUT /identity/v3/projects/d9ebc59b4c8745f2aaaaba5b0aa10ee3/users/b532f5d44b9b41b9b1c591dd895c4002/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:50.850135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a5d6-03a0-48a0-8b28-5d6cbc57c511 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:50.850528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a5d6-03a0-48a0-8b28-5d6cbc57c511 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:50.850860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a5d6-03a0-48a0-8b28-5d6cbc57c511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:50.855147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 844/1703] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:50.861438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94f6a-a14f-42c0-9cb9-791f65eb87b9 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:50.901214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94f6a-a14f-42c0-9cb9-791f65eb87b9 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:50.929041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3d85a5d6-03a0-48a0-8b28-5d6cbc57c511 None None] MFA Rules not processed for user `b532f5d44b9b41b9b1c591dd895c4002`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:50.930391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3d85a5d6-03a0-48a0-8b28-5d6cbc57c511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:51.118919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39348114-3aa5-413c-88f4-2c82dcc0ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:51.120031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39348114-3aa5-413c-88f4-2c82dcc0ca85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:51.120480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39348114-3aa5-413c-88f4-2c82dcc0ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:51.120889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39348114-3aa5-413c-88f4-2c82dcc0ca85 admin admin] PATH_INFO: `/v3/projects/0ebe6a3b0f8a4d08be8d546d3940eb74/users/419739fae3e4496382211d2d9456c782/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:51.141986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39348114-3aa5-413c-88f4-2c82dcc0ca85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebe6a3b0f8a4d08be8d546d3940eb74, user_id=419739fae3e4496382211d2d9456c782, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:51.145839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39348114-3aa5-413c-88f4-2c82dcc0ca85 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:51.151479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 860/1704] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:25:51.156570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc5562-ed85-4675-8d8b-ba76c45d43bb None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:51.156874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc5562-ed85-4675-8d8b-ba76c45d43bb None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:51.157155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc5562-ed85-4675-8d8b-ba76c45d43bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:51.201286 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 845/1705] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:50 2022] PUT /identity/v3/projects/0ebe6a3b0f8a4d08be8d546d3940eb74/users/419739fae3e4496382211d2d9456c782/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:51.203405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39348114-3aa5-413c-88f4-2c82dcc0ca85 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:51.209205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-39348114-3aa5-413c-88f4-2c82dcc0ca85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:51.223481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e4fc5562-ed85-4675-8d8b-ba76c45d43bb None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:51.225644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e4fc5562-ed85-4675-8d8b-ba76c45d43bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:51.369729 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39348114-3aa5-413c-88f4-2c82dcc0ca85 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:51.380841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37adb51-d415-4915-8fbc-3a3c70f15c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:51.383904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37adb51-d415-4915-8fbc-3a3c70f15c8d service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:51.385123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37adb51-d415-4915-8fbc-3a3c70f15c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:51.385413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37adb51-d415-4915-8fbc-3a3c70f15c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:51.402996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 861/1706] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:25:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:51.405636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683db08f-173f-48b0-bd54-0c91c61e466b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:51.408044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683db08f-173f-48b0-bd54-0c91c61e466b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:51.408615 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683db08f-173f-48b0-bd54-0c91c61e466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:51.469983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-683db08f-173f-48b0-bd54-0c91c61e466b None None] MFA Rules not processed for user `419739fae3e4496382211d2d9456c782`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:51.472809 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-683db08f-173f-48b0-bd54-0c91c61e466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:51.540840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37adb51-d415-4915-8fbc-3a3c70f15c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:51.545419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37adb51-d415-4915-8fbc-3a3c70f15c8d service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:51.571690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 846/1707] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:51 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:51.622690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 862/1708] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:51.646526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1f04-1d98-479c-98ab-fdb0553e5433 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:51.649873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1f04-1d98-479c-98ab-fdb0553e5433 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:51.650240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d1f04-1d98-479c-98ab-fdb0553e5433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:51.668306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683db08f-173f-48b0-bd54-0c91c61e466b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:51.669772 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-683db08f-173f-48b0-bd54-0c91c61e466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:51.760264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-327d1f04-1d98-479c-98ab-fdb0553e5433 None None] MFA Rules not processed for user `e548e01902ba41e79667ed56d602f19a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:51.762705 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-327d1f04-1d98-479c-98ab-fdb0553e5433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:51.860788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683db08f-173f-48b0-bd54-0c91c61e466b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:51.872876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293db7b-d3ad-43fb-925a-251502305030 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:51.873602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293db7b-d3ad-43fb-925a-251502305030 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:51.873881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293db7b-d3ad-43fb-925a-251502305030 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:51.875677 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293db7b-d3ad-43fb-925a-251502305030 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:51.910724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293db7b-d3ad-43fb-925a-251502305030 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:51.912308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 847/1709] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:51.914993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d1f04-1d98-479c-98ab-fdb0553e5433 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:51.916100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4293db7b-d3ad-43fb-925a-251502305030 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:51.927988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d1f04-1d98-479c-98ab-fdb0553e5433 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:51.932144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad55ab2-30a1-43f4-b54e-082c2399f69b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:51.933124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad55ab2-30a1-43f4-b54e-082c2399f69b service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:51.934149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad55ab2-30a1-43f4-b54e-082c2399f69b service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:51.934707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad55ab2-30a1-43f4-b54e-082c2399f69b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:51.939830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 863/1710] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:25:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 00:25:51.949630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad55ab2-30a1-43f4-b54e-082c2399f69b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:51.953573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293db7b-d3ad-43fb-925a-251502305030 service swift] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:51.958478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad55ab2-30a1-43f4-b54e-082c2399f69b service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:52.002376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 848/1711] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:52.143176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad55ab2-30a1-43f4-b54e-082c2399f69b service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:52.251939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293db7b-d3ad-43fb-925a-251502305030 service swift] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:52.262919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad55ab2-30a1-43f4-b54e-082c2399f69b service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:52.273799 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:52.274684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:52.275062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:52.275341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] PATH_INFO: `/v3/users/027299219c51453294b69cc441e57023` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:52.277030 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] RBAC: Authorizing `identity:delete_user(user_id=027299219c51453294b69cc441e57023)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:52.278769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94cd28-9104-45b0-8a3e-856e4555ca60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:52.279122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:52.290482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94cd28-9104-45b0-8a3e-856e4555ca60 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:52.290482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94cd28-9104-45b0-8a3e-856e4555ca60 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:52.290482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94cd28-9104-45b0-8a3e-856e4555ca60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:52.314372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94cd28-9104-45b0-8a3e-856e4555ca60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:52.324178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94cd28-9104-45b0-8a3e-856e4555ca60 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:52.368963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 864/1712] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:52.480291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '027299219c51453294b69cc441e57023'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:52.495808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '027299219c51453294b69cc441e57023'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:52.509609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '027299219c51453294b69cc441e57023'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:52.510407 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '027299219c51453294b69cc441e57023'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:52.511156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '027299219c51453294b69cc441e57023'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:52.557540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 849/1713] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:25:52 2022] DELETE /identity/v3/users/027299219c51453294b69cc441e57023 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:25:52.561944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ce40-10ab-4b1a-b2f4-44ab3a29c7a6 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:52.562349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ce40-10ab-4b1a-b2f4-44ab3a29c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:52.562705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6ce40-10ab-4b1a-b2f4-44ab3a29c7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:52.601788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-82c6ce40-10ab-4b1a-b2f4-44ab3a29c7a6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:52.613051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-82c6ce40-10ab-4b1a-b2f4-44ab3a29c7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:52.891340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 865/1714] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:52.926420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:52.928964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:53.192084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4cacc-2aa2-41a1-a39e-c7f15231c91d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:53.211062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62792f-382a-433b-b429-37342959e8e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:53.211831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62792f-382a-433b-b429-37342959e8e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:53.212175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62792f-382a-433b-b429-37342959e8e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:53.212402 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62792f-382a-433b-b429-37342959e8e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:53.251538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62792f-382a-433b-b429-37342959e8e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:53.253124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62792f-382a-433b-b429-37342959e8e4 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:53.306497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 850/1715] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:53.908071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ce40-10ab-4b1a-b2f4-44ab3a29c7a6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:53.909598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-82c6ce40-10ab-4b1a-b2f4-44ab3a29c7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:53.944386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6ce40-10ab-4b1a-b2f4-44ab3a29c7a6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:53.968564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:53.972759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:53.975833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:53.978495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] PATH_INFO: `/v3/users/925d4fd16dce4e5982c9a732037f3fc8` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:53.985944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=925d4fd16dce4e5982c9a732037f3fc8)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:53.991044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:54.196144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925d4fd16dce4e5982c9a732037f3fc8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:54.231093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925d4fd16dce4e5982c9a732037f3fc8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:54.267538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925d4fd16dce4e5982c9a732037f3fc8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:54.269263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925d4fd16dce4e5982c9a732037f3fc8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:54.271319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925d4fd16dce4e5982c9a732037f3fc8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:54.402697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 866/1716] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:25:53 2022] DELETE /identity/v3/users/925d4fd16dce4e5982c9a732037f3fc8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:54.404672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21125834-ef92-48ca-b3d1-779eae11f401 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:54.405311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21125834-ef92-48ca-b3d1-779eae11f401 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:54.405311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21125834-ef92-48ca-b3d1-779eae11f401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:54.433388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-21125834-ef92-48ca-b3d1-779eae11f401 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:54.434926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-21125834-ef92-48ca-b3d1-779eae11f401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:54.689398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 851/1717] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:54.876982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:54.879821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:55.076116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0325d0-1f09-49a9-9e00-28d07c74ec06 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:55.086550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5aae1-09a2-4dee-999f-98959582fd26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:55.087636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5aae1-09a2-4dee-999f-98959582fd26 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:55.088134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5aae1-09a2-4dee-999f-98959582fd26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:55.088666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5aae1-09a2-4dee-999f-98959582fd26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:55.108917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5aae1-09a2-4dee-999f-98959582fd26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:55.111756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5aae1-09a2-4dee-999f-98959582fd26 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:55.140986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 867/1718] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:55.630984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12777f3f-81b2-41b0-a128-a598b29068ff None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:55.631904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12777f3f-81b2-41b0-a128-a598b29068ff None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:55.632338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12777f3f-81b2-41b0-a128-a598b29068ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:55.710845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-12777f3f-81b2-41b0-a128-a598b29068ff None None] MFA Rules not processed for user `a99a9951d83446efbf819b72836afc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:55.713716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-12777f3f-81b2-41b0-a128-a598b29068ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:55.740755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 852/1719] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Apr 12 00:25:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:55.797724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5aae1-09a2-4dee-999f-98959582fd26 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:55.799940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f9d5aae1-09a2-4dee-999f-98959582fd26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:55.825029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5aae1-09a2-4dee-999f-98959582fd26 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:55.875033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931cc26-f2f0-409b-87fa-f7b7940e6e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:55.879151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931cc26-f2f0-409b-87fa-f7b7940e6e80 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:55.879621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931cc26-f2f0-409b-87fa-f7b7940e6e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:55.880016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931cc26-f2f0-409b-87fa-f7b7940e6e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:55.915754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931cc26-f2f0-409b-87fa-f7b7940e6e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:55.917377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931cc26-f2f0-409b-87fa-f7b7940e6e80 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:55.924567 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12777f3f-81b2-41b0-a128-a598b29068ff None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:55.926238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-12777f3f-81b2-41b0-a128-a598b29068ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:55.966929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 868/1720] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:25:55.968421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12777f3f-81b2-41b0-a128-a598b29068ff None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:55.981928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:55.983079 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:55.983511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:55.983956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] PATH_INFO: `/v3/users/795a5b51f28b4718ab4e009907960953` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:55.992334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=795a5b51f28b4718ab4e009907960953)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:55.994739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:56.106071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795a5b51f28b4718ab4e009907960953'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:56.126533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795a5b51f28b4718ab4e009907960953'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:56.144134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795a5b51f28b4718ab4e009907960953'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:56.147333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795a5b51f28b4718ab4e009907960953'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:56.150168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795a5b51f28b4718ab4e009907960953'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:56.178200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 853/1721] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:25:55 2022] DELETE /identity/v3/users/795a5b51f28b4718ab4e009907960953 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:25:56.183472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90572ea-5a72-4bc0-a368-ba08653c1a05 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:56.184359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90572ea-5a72-4bc0-a368-ba08653c1a05 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:56.184784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90572ea-5a72-4bc0-a368-ba08653c1a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:56.224755 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e90572ea-5a72-4bc0-a368-ba08653c1a05 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:56.226036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e90572ea-5a72-4bc0-a368-ba08653c1a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:56.321279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 869/1722] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:56.362617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:56.364446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:56.504618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048dad41-baca-40cd-8270-a52aa3a61f76 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:56.515002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287830c6-0839-491e-9afb-420a37c7aae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:56.516020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287830c6-0839-491e-9afb-420a37c7aae0 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:56.516020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287830c6-0839-491e-9afb-420a37c7aae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:56.516326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287830c6-0839-491e-9afb-420a37c7aae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:56.527422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7105bb-c6d2-4b63-99a3-8f91ceb6c385 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:56.527804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7105bb-c6d2-4b63-99a3-8f91ceb6c385 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:56.528094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7105bb-c6d2-4b63-99a3-8f91ceb6c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:56.534208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287830c6-0839-491e-9afb-420a37c7aae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:56.535692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287830c6-0839-491e-9afb-420a37c7aae0 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:56.565785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 854/1723] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:25:56.593549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ac7105bb-c6d2-4b63-99a3-8f91ceb6c385 None None] MFA Rules not processed for user `b434038833084579adf853df718315b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:56.599956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ac7105bb-c6d2-4b63-99a3-8f91ceb6c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:56.755757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287830c6-0839-491e-9afb-420a37c7aae0 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:56.757738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-287830c6-0839-491e-9afb-420a37c7aae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:56.789656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287830c6-0839-491e-9afb-420a37c7aae0 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:56.820311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:56.821423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:56.821878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:56.822348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] PATH_INFO: `/v3/projects/7feba8302a674b08bd89c0aa02e8f0dc` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:56.824348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7feba8302a674b08bd89c0aa02e8f0dc)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:56.827135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:56.831909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 870/1724] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:56.834882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7896d0-1e2e-4d71-b2b6-253e97904f0e None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:56.841357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7896d0-1e2e-4d71-b2b6-253e97904f0e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:56.841357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7896d0-1e2e-4d71-b2b6-253e97904f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:56.895294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-8a7896d0-1e2e-4d71-b2b6-253e97904f0e None None] MFA Rules not processed for user `b434038833084579adf853df718315b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:56.895294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8a7896d0-1e2e-4d71-b2b6-253e97904f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:56.922244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 871/1725] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:56.935771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7896d0-1e2e-4d71-b2b6-253e97904f0e None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:56.939345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8a7896d0-1e2e-4d71-b2b6-253e97904f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:56.986170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7feba8302a674b08bd89c0aa02e8f0dc', 'request_id': 'req-adec52d3-6bd3-4821-8cfb-ce5343326e82'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.004195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7feba8302a674b08bd89c0aa02e8f0dc', 'request_id': 'req-adec52d3-6bd3-4821-8cfb-ce5343326e82'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.030174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7feba8302a674b08bd89c0aa02e8f0dc', 'request_id': 'req-adec52d3-6bd3-4821-8cfb-ce5343326e82'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.062059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] The token cache is being invalidate because project 7feba8302a674b08bd89c0aa02e8f0dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:25:57.073135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.074693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.084384 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 855/1726] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:25:56 2022] DELETE /identity/v3/projects/7feba8302a674b08bd89c0aa02e8f0dc => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:25:57.085575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:57.088029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:57.278348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7896d0-1e2e-4d71-b2b6-253e97904f0e None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:57.318647 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec52d3-6bd3-4821-8cfb-ce5343326e82 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:57.324010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:57.325119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:57.325549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:57.325966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] PATH_INFO: `/v3/users/419739fae3e4496382211d2d9456c782` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:57.327480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419739fae3e4496382211d2d9456c782)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:57.334124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:57.492912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419739fae3e4496382211d2d9456c782'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.509819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:57.513991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:57.514172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419739fae3e4496382211d2d9456c782'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.516336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:57.516664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:57.522817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:57.551475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419739fae3e4496382211d2d9456c782'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.552982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419739fae3e4496382211d2d9456c782'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.553565 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6d9f341a-7678-4b07-9bde-1e928f035f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419739fae3e4496382211d2d9456c782'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:57.626972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 856/1727] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:25:57 2022] DELETE /identity/v3/users/419739fae3e4496382211d2d9456c782 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:57.716997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:57.723123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:57.755908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 872/1728] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:25:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 818 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:25:58.010201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0325a-77d2-47b8-9efc-7a9f62e95700 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:58.011274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0325a-77d2-47b8-9efc-7a9f62e95700 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:58.011828 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0325a-77d2-47b8-9efc-7a9f62e95700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:58.039263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:58.041075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:58.073095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc432dbe-8755-4a24-a439-0d40b2e016a6 service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:58.078439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-4da0325a-77d2-47b8-9efc-7a9f62e95700 None None] MFA Rules not processed for user `f0fad81c4cbd4335967e97fd7de9963d`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:58.081185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4da0325a-77d2-47b8-9efc-7a9f62e95700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:58.225728 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:58.227927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:58.228457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 857/1729] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:58.228689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:58.228970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] PATH_INFO: `/v3/projects/ab4b2a84b4e14e2f97768fe79385f8a9` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:58.230319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4b2a84b4e14e2f97768fe79385f8a9)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:58.232331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:58.321915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4b2a84b4e14e2f97768fe79385f8a9', 'request_id': 'req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:58.343042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4b2a84b4e14e2f97768fe79385f8a9', 'request_id': 'req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:58.363901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4b2a84b4e14e2f97768fe79385f8a9', 'request_id': 'req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:58.395323 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] The token cache is being invalidate because project ab4b2a84b4e14e2f97768fe79385f8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:25:58.396610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:58.398275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bc0f15c5-402c-4a2c-a6b6-8e59b581edf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:25:58.402723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 873/1730] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:25:58 2022] DELETE /identity/v3/projects/ab4b2a84b4e14e2f97768fe79385f8a9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:25:58.407855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0be1a-6893-4403-aaa4-62f3d6f177f8 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:58.408338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0be1a-6893-4403-aaa4-62f3d6f177f8 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:58.408967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0be1a-6893-4403-aaa4-62f3d6f177f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:58.433153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a7d0be1a-6893-4403-aaa4-62f3d6f177f8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:58.453195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a7d0be1a-6893-4403-aaa4-62f3d6f177f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:58.755416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 858/1731] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:58.765540 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a984cbc-d35b-419d-ad62-e9ebe6e9207f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:58.766343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a984cbc-d35b-419d-ad62-e9ebe6e9207f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:58.766788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a984cbc-d35b-419d-ad62-e9ebe6e9207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:58.845153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3a984cbc-d35b-419d-ad62-e9ebe6e9207f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:25:58.855478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3a984cbc-d35b-419d-ad62-e9ebe6e9207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:58.921893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 874/1732] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:25:58.923641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0be1a-6893-4403-aaa4-62f3d6f177f8 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:58.943202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0be1a-6893-4403-aaa4-62f3d6f177f8 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:58.992475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5e864-9da8-4873-af38-8765d85d0b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:58.993425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e864-9da8-4873-af38-8765d85d0b81 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:58.993937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e864-9da8-4873-af38-8765d85d0b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:58.994418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e864-9da8-4873-af38-8765d85d0b81 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:58.995309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5e864-9da8-4873-af38-8765d85d0b81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:25:58.995784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5e864-9da8-4873-af38-8765d85d0b81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:58.998224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5e864-9da8-4873-af38-8765d85d0b81 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:59.053604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 859/1733] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:25:59.054893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a984cbc-d35b-419d-ad62-e9ebe6e9207f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:59.067041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a984cbc-d35b-419d-ad62-e9ebe6e9207f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:59.091709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c0d90-6976-45a8-836a-25b193295dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:59.092543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c0d90-6976-45a8-836a-25b193295dcd admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:59.093166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c0d90-6976-45a8-836a-25b193295dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:59.093166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c0d90-6976-45a8-836a-25b193295dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:59.103351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c0d90-6976-45a8-836a-25b193295dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:59.109798 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c0d90-6976-45a8-836a-25b193295dcd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:59.219128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 875/1734] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:25:59 2022] POST /identity/v3/projects => generated 403 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:59.220096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5e864-9da8-4873-af38-8765d85d0b81 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:59.248374 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5e864-9da8-4873-af38-8765d85d0b81 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:59.509351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eef472-a6cb-4fdc-b583-0a49f0e61204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:59.510081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eef472-a6cb-4fdc-b583-0a49f0e61204 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:59.510403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eef472-a6cb-4fdc-b583-0a49f0e61204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:59.527148 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eef472-a6cb-4fdc-b583-0a49f0e61204 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:59.527986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eef472-a6cb-4fdc-b583-0a49f0e61204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:59.540596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eef472-a6cb-4fdc-b583-0a49f0e61204 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:59.615758 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 860/1735] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:25:59 2022] POST /identity/v3/users => generated 302 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:25:59.617187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c0d90-6976-45a8-836a-25b193295dcd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:59.634002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c0d90-6976-45a8-836a-25b193295dcd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:59.649071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d9871-e62f-4a37-937d-8caac9668a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:59.649828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d9871-e62f-4a37-937d-8caac9668a51 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:59.650123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d9871-e62f-4a37-937d-8caac9668a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:59.650414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d9871-e62f-4a37-937d-8caac9668a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:59.651223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d9871-e62f-4a37-937d-8caac9668a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:59.653199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d9871-e62f-4a37-937d-8caac9668a51 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:59.681405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 876/1736] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:59.682720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eef472-a6cb-4fdc-b583-0a49f0e61204 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:59.699263 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eef472-a6cb-4fdc-b583-0a49f0e61204 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:59.723167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b370d-5e63-4591-8cbb-be97c40915de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:59.723967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b370d-5e63-4591-8cbb-be97c40915de admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:59.724256 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b370d-5e63-4591-8cbb-be97c40915de admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:59.724532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b370d-5e63-4591-8cbb-be97c40915de admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:59.725276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b370d-5e63-4591-8cbb-be97c40915de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:59.729915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b370d-5e63-4591-8cbb-be97c40915de admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:59.791449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 861/1737] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:25:59.793138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d9871-e62f-4a37-937d-8caac9668a51 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:59.808578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b370d-5e63-4591-8cbb-be97c40915de admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:25:59.810052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d9871-e62f-4a37-937d-8caac9668a51 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:59.810606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e59b370d-5e63-4591-8cbb-be97c40915de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:25:59.835179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ec69e-771b-4198-9b59-0dbcb8abc36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:59.836817 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b370d-5e63-4591-8cbb-be97c40915de admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:25:59.842095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ec69e-771b-4198-9b59-0dbcb8abc36f admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:59.844552 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ec69e-771b-4198-9b59-0dbcb8abc36f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:59.845945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ec69e-771b-4198-9b59-0dbcb8abc36f admin admin] PATH_INFO: `/v3/projects/a70727cd1f194aba8969c7a0f0818fd4/users/0aa5197162a747d88e7a9f7b6c8955ca/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:59.849309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:25:59.854879 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:25:59.855291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:25:59.855589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] PATH_INFO: `/v3/projects/0723b8c5f02843ba8d5375ad96fa51bf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:25:59.859072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0723b8c5f02843ba8d5375ad96fa51bf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:59.863008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:59.946141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ec69e-771b-4198-9b59-0dbcb8abc36f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a70727cd1f194aba8969c7a0f0818fd4, user_id=0aa5197162a747d88e7a9f7b6c8955ca, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:25:59.950388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2ec69e-771b-4198-9b59-0dbcb8abc36f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:25:59.992313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0723b8c5f02843ba8d5375ad96fa51bf', 'request_id': 'req-bd6f9077-692e-40db-85ce-ecce14cc0069'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.012119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0723b8c5f02843ba8d5375ad96fa51bf', 'request_id': 'req-bd6f9077-692e-40db-85ce-ecce14cc0069'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.024416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 877/1738] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:25:59 2022] PUT /identity/v3/projects/a70727cd1f194aba8969c7a0f0818fd4/users/0aa5197162a747d88e7a9f7b6c8955ca/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:00.027224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0723b8c5f02843ba8d5375ad96fa51bf', 'request_id': 'req-bd6f9077-692e-40db-85ce-ecce14cc0069'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.036067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07be6b-d569-45e1-8a51-33d96780ded7 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:00.036067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07be6b-d569-45e1-8a51-33d96780ded7 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:00.037031 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07be6b-d569-45e1-8a51-33d96780ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:00.087240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] The token cache is being invalidate because project 0723b8c5f02843ba8d5375ad96fa51bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:00.087823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.091999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.104854 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 862/1739] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:25:59 2022] DELETE /identity/v3/projects/0723b8c5f02843ba8d5375ad96fa51bf => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:00.108375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:00.114679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:00.164465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-7c07be6b-d569-45e1-8a51-33d96780ded7 None None] MFA Rules not processed for user `0aa5197162a747d88e7a9f7b6c8955ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:00.179548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7c07be6b-d569-45e1-8a51-33d96780ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:00.264992 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f9077-692e-40db-85ce-ecce14cc0069 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:00.368993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:00.369897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:00.370332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:00.370552 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] PATH_INFO: `/v3/users/b532f5d44b9b41b9b1c591dd895c4002` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:00.371813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b532f5d44b9b41b9b1c591dd895c4002)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:00.374322 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:00.470865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 878/1740] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:00.476783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfdfb6-c031-4213-a820-cba53b42f232 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:00.482704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfdfb6-c031-4213-a820-cba53b42f232 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:00.483277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfdfb6-c031-4213-a820-cba53b42f232 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:00.496135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 879/1741] 10.222.0.32 () {54 vars in 912 bytes} [Tue Apr 12 00:26:00 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:26:00.496996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b532f5d44b9b41b9b1c591dd895c4002'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.500240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfdfb6-c031-4213-a820-cba53b42f232 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:00.512786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-63dfdfb6-c031-4213-a820-cba53b42f232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:00.519593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b532f5d44b9b41b9b1c591dd895c4002'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.542114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b532f5d44b9b41b9b1c591dd895c4002'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.542905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b532f5d44b9b41b9b1c591dd895c4002'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.543546 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b31ecc3f-52d6-4c75-8c93-816864052043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b532f5d44b9b41b9b1c591dd895c4002'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:00.563715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfdfb6-c031-4213-a820-cba53b42f232 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:00.581057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b50db-d964-42e4-bed9-a0b6670874e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:00.582501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b50db-d964-42e4-bed9-a0b6670874e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:00.582800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b50db-d964-42e4-bed9-a0b6670874e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:00.586517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b50db-d964-42e4-bed9-a0b6670874e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:00.587388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b50db-d964-42e4-bed9-a0b6670874e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:00.593826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b50db-d964-42e4-bed9-a0b6670874e5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:00.597237 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 863/1742] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:00 2022] DELETE /identity/v3/users/b532f5d44b9b41b9b1c591dd895c4002 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:00.598937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc1f7-02fb-4a81-8a1e-5e15708d719f None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:00.599882 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc1f7-02fb-4a81-8a1e-5e15708d719f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:00.604149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1bc1f7-02fb-4a81-8a1e-5e15708d719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:00.645586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 880/1743] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:00 2022] POST /identity/v3/projects => generated 405 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:00.650236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b50db-d964-42e4-bed9-a0b6670874e5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:00.654019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-916b50db-d964-42e4-bed9-a0b6670874e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:00.684735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fc1bc1f7-02fb-4a81-8a1e-5e15708d719f None None] MFA Rules not processed for user `a99a9951d83446efbf819b72836afc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:00.688095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fc1bc1f7-02fb-4a81-8a1e-5e15708d719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:00.764492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b50db-d964-42e4-bed9-a0b6670874e5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:00.773554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796afc80-78de-42f5-8fa7-ddd4a64bfb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:00.775180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796afc80-78de-42f5-8fa7-ddd4a64bfb7c admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:00.775447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796afc80-78de-42f5-8fa7-ddd4a64bfb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:00.775846 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796afc80-78de-42f5-8fa7-ddd4a64bfb7c admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:00.776898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796afc80-78de-42f5-8fa7-ddd4a64bfb7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:00.781505 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796afc80-78de-42f5-8fa7-ddd4a64bfb7c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:00.827807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 881/1744] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:00 2022] POST /identity/v3/users => generated 309 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:00.831968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796afc80-78de-42f5-8fa7-ddd4a64bfb7c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:00.852730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796afc80-78de-42f5-8fa7-ddd4a64bfb7c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:00.874754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cbb3c-f336-41fb-8dd2-a153d6563c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:00.877985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cbb3c-f336-41fb-8dd2-a153d6563c33 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:00.877985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cbb3c-f336-41fb-8dd2-a153d6563c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:00.877985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cbb3c-f336-41fb-8dd2-a153d6563c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:00.881510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cbb3c-f336-41fb-8dd2-a153d6563c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:00.885262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cbb3c-f336-41fb-8dd2-a153d6563c33 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:00.912112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 864/1745] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:26:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:00.964857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 882/1746] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:00.968279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bc1f7-02fb-4a81-8a1e-5e15708d719f None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:00.988728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1bc1f7-02fb-4a81-8a1e-5e15708d719f None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:01.007121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3120a7-16b6-4973-88d5-f204892727ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:01.009740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3120a7-16b6-4973-88d5-f204892727ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:01.012426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3120a7-16b6-4973-88d5-f204892727ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:01.012738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3120a7-16b6-4973-88d5-f204892727ac admin admin] PATH_INFO: `/v3/projects/36438e6a2abb477c95a90fc7d5f3f053/users/cef1f53b4f8f464685b547437f231659/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:01.071426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a3c5-9d67-4f1a-98a5-216d9c371e82 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:01.071887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a3c5-9d67-4f1a-98a5-216d9c371e82 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:01.072494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a3c5-9d67-4f1a-98a5-216d9c371e82 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:01.074989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 883/1747] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:26:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:26:01.075628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3120a7-16b6-4973-88d5-f204892727ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=36438e6a2abb477c95a90fc7d5f3f053, user_id=cef1f53b4f8f464685b547437f231659, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:01.089429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3120a7-16b6-4973-88d5-f204892727ac admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:01.189651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 865/1748] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:00 2022] PUT /identity/v3/projects/36438e6a2abb477c95a90fc7d5f3f053/users/cef1f53b4f8f464685b547437f231659/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:01.193297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46a3c5-9d67-4f1a-98a5-216d9c371e82 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:01.304389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3120a7-16b6-4973-88d5-f204892727ac admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:01.306376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3f3120a7-16b6-4973-88d5-f204892727ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:01.338916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46a3c5-9d67-4f1a-98a5-216d9c371e82 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:01.341305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3120a7-16b6-4973-88d5-f204892727ac admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:01.357380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe2f71-3e55-457c-80b4-f4e0da2a9dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:01.357548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe2f71-3e55-457c-80b4-f4e0da2a9dad admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:01.358678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe2f71-3e55-457c-80b4-f4e0da2a9dad admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:01.359820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe2f71-3e55-457c-80b4-f4e0da2a9dad admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:01.363192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:01.366686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:01.368843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe2f71-3e55-457c-80b4-f4e0da2a9dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:01.370901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:01.371380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] PATH_INFO: `/v3/projects/0ebe6a3b0f8a4d08be8d546d3940eb74` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:01.372603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe2f71-3e55-457c-80b4-f4e0da2a9dad admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:01.377508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ebe6a3b0f8a4d08be8d546d3940eb74)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:01.392724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:01.418073 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 884/1749] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:01.422424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe2f71-3e55-457c-80b4-f4e0da2a9dad admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:01.428379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6cbe2f71-3e55-457c-80b4-f4e0da2a9dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:01.579491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebe6a3b0f8a4d08be8d546d3940eb74', 'request_id': 'req-60010362-c776-41d3-ae06-72d527d69376'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:01.608827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebe6a3b0f8a4d08be8d546d3940eb74', 'request_id': 'req-60010362-c776-41d3-ae06-72d527d69376'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:01.626063 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebe6a3b0f8a4d08be8d546d3940eb74', 'request_id': 'req-60010362-c776-41d3-ae06-72d527d69376'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:01.660283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe2f71-3e55-457c-80b4-f4e0da2a9dad admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:01.667335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] The token cache is being invalidate because project 0ebe6a3b0f8a4d08be8d546d3940eb74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:01.669223 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:01.673998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:01.685203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 866/1750] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:01 2022] DELETE /identity/v3/projects/0ebe6a3b0f8a4d08be8d546d3940eb74 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:01.690367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:01.703401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:01.890810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eb2a7-7b65-44dc-9823-18b1c25eda11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:01.891525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eb2a7-7b65-44dc-9823-18b1c25eda11 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:01.891804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eb2a7-7b65-44dc-9823-18b1c25eda11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:01.892079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eb2a7-7b65-44dc-9823-18b1c25eda11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:01.895486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-be9eb2a7-7b65-44dc-9823-18b1c25eda11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:01.923020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9eb2a7-7b65-44dc-9823-18b1c25eda11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:01.924758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9eb2a7-7b65-44dc-9823-18b1c25eda11 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:01.943436 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 885/1751] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:01.944473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60010362-c776-41d3-ae06-72d527d69376 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:01.946495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db17a-0f3d-47a6-b801-a56ef5c48b28 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:01.946807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db17a-0f3d-47a6-b801-a56ef5c48b28 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:01.947135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db17a-0f3d-47a6-b801-a56ef5c48b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:01.971438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf092bf4-2716-43e8-9987-6a6c076254fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:01.974928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf092bf4-2716-43e8-9987-6a6c076254fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:01.975898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf092bf4-2716-43e8-9987-6a6c076254fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:01.977051 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf092bf4-2716-43e8-9987-6a6c076254fb admin admin] PATH_INFO: `/v3/projects/36438e6a2abb477c95a90fc7d5f3f053/users/cef1f53b4f8f464685b547437f231659/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:01.992420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf092bf4-2716-43e8-9987-6a6c076254fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=36438e6a2abb477c95a90fc7d5f3f053, user_id=cef1f53b4f8f464685b547437f231659, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:01.996551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-754db17a-0f3d-47a6-b801-a56ef5c48b28 None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:01.997988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-754db17a-0f3d-47a6-b801-a56ef5c48b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:01.999971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf092bf4-2716-43e8-9987-6a6c076254fb admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:02.059242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 867/1752] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:01 2022] PUT /identity/v3/projects/36438e6a2abb477c95a90fc7d5f3f053/users/cef1f53b4f8f464685b547437f231659/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:02.063200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d947df-dbf1-44a8-8017-92fc66c522df None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:02.064246 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d947df-dbf1-44a8-8017-92fc66c522df None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:02.064900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d947df-dbf1-44a8-8017-92fc66c522df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:02.133725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-48d947df-dbf1-44a8-8017-92fc66c522df None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:02.136886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-48d947df-dbf1-44a8-8017-92fc66c522df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:02.198668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 886/1753] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:02.200805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f05f-7c3d-4be8-a4f3-f136fd781810 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:02.201290 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f05f-7c3d-4be8-a4f3-f136fd781810 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:02.201859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9f05f-7c3d-4be8-a4f3-f136fd781810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:02.271930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-88b9f05f-7c3d-4be8-a4f3-f136fd781810 None None] MFA Rules not processed for user `cef1f53b4f8f464685b547437f231659`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:02.273907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-88b9f05f-7c3d-4be8-a4f3-f136fd781810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:02.393091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 868/1754] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:02.401558 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2d32e-089b-4b7c-83c6-501c3eca4087 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:02.402099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2d32e-089b-4b7c-83c6-501c3eca4087 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:02.402412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2d32e-089b-4b7c-83c6-501c3eca4087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:02.438216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-53e2d32e-089b-4b7c-83c6-501c3eca4087 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:02.444626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-53e2d32e-089b-4b7c-83c6-501c3eca4087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:02.467462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 869/1755] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:02.470456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2d32e-089b-4b7c-83c6-501c3eca4087 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:02.480298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 887/1756] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:02.481340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f05f-7c3d-4be8-a4f3-f136fd781810 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:02.483176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2d32e-089b-4b7c-83c6-501c3eca4087 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:02.492887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-88b9f05f-7c3d-4be8-a4f3-f136fd781810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:02.528472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038357c1-ba30-45b3-bb2e-c2dd3711cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:02.531708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038357c1-ba30-45b3-bb2e-c2dd3711cdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:02.533598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038357c1-ba30-45b3-bb2e-c2dd3711cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:02.535189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038357c1-ba30-45b3-bb2e-c2dd3711cdc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:02.539445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038357c1-ba30-45b3-bb2e-c2dd3711cdc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:02.540387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038357c1-ba30-45b3-bb2e-c2dd3711cdc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:02.547477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038357c1-ba30-45b3-bb2e-c2dd3711cdc3 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:02.568827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 870/1757] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:02.573210 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038357c1-ba30-45b3-bb2e-c2dd3711cdc3 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:02.597071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038357c1-ba30-45b3-bb2e-c2dd3711cdc3 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:02.610091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30790acd-95fe-451e-9903-356085178ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:02.611772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30790acd-95fe-451e-9903-356085178ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:02.612354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30790acd-95fe-451e-9903-356085178ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:02.613827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30790acd-95fe-451e-9903-356085178ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:02.615779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30790acd-95fe-451e-9903-356085178ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:02.618831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30790acd-95fe-451e-9903-356085178ab6 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:02.681801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9f05f-7c3d-4be8-a4f3-f136fd781810 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:02.691757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260a6cd-3c50-4bd8-b38d-238b3b7ee1f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:02.693584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260a6cd-3c50-4bd8-b38d-238b3b7ee1f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:02.694057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260a6cd-3c50-4bd8-b38d-238b3b7ee1f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:02.694549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260a6cd-3c50-4bd8-b38d-238b3b7ee1f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:02.703207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 871/1758] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:02 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:02.704681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30790acd-95fe-451e-9903-356085178ab6 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:02.726445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260a6cd-3c50-4bd8-b38d-238b3b7ee1f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:02.730619 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260a6cd-3c50-4bd8-b38d-238b3b7ee1f2 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:02.784969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 888/1759] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:02 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:02.935400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30790acd-95fe-451e-9903-356085178ab6 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:02.951662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a932dbd-01dd-42fd-9755-afad46d2ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:02.955349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a932dbd-01dd-42fd-9755-afad46d2ffaf admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:02.957113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a932dbd-01dd-42fd-9755-afad46d2ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:02.957620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a932dbd-01dd-42fd-9755-afad46d2ffaf admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:02.958732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a932dbd-01dd-42fd-9755-afad46d2ffaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:02.963487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a932dbd-01dd-42fd-9755-afad46d2ffaf admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:03.095837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260a6cd-3c50-4bd8-b38d-238b3b7ee1f2 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:03.108643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260a6cd-3c50-4bd8-b38d-238b3b7ee1f2 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:03.108963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 872/1760] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:02 2022] POST /identity/v3/users => generated 287 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:03.110025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a932dbd-01dd-42fd-9755-afad46d2ffaf admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:03.120566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:03.126115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:03.126676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:03.127850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] PATH_INFO: `/v3/users/0aa5197162a747d88e7a9f7b6c8955ca` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:03.142874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa5197162a747d88e7a9f7b6c8955ca)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:03.156118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:03.187847 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a932dbd-01dd-42fd-9755-afad46d2ffaf admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:03.219136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6c12-b22e-4a36-b83f-363d2bb384b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:03.233134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6c12-b22e-4a36-b83f-363d2bb384b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:03.233437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6c12-b22e-4a36-b83f-363d2bb384b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:03.236364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6c12-b22e-4a36-b83f-363d2bb384b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:03.250475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b6c12-b22e-4a36-b83f-363d2bb384b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:03.253041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa5197162a747d88e7a9f7b6c8955ca'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:03.254162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b6c12-b22e-4a36-b83f-363d2bb384b3 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:03.262347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa5197162a747d88e7a9f7b6c8955ca'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:03.290367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa5197162a747d88e7a9f7b6c8955ca'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:03.291054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa5197162a747d88e7a9f7b6c8955ca'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:03.293054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa5197162a747d88e7a9f7b6c8955ca'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:03.345494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 873/1761] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:03.347164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6c12-b22e-4a36-b83f-363d2bb384b3 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:03.360745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c60b6c12-b22e-4a36-b83f-363d2bb384b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:03.390919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 889/1762] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:03 2022] DELETE /identity/v3/users/0aa5197162a747d88e7a9f7b6c8955ca => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:03.391969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:03.400945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:03.423153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6c12-b22e-4a36-b83f-363d2bb384b3 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:03.730348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfec04a-f8d0-4af1-ac1b-a85dcae43d0e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:03.778934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1a60-8139-4dea-a892-fe427427042e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:03.779615 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1a60-8139-4dea-a892-fe427427042e service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:03.780012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1a60-8139-4dea-a892-fe427427042e service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:03.780251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d1a60-8139-4dea-a892-fe427427042e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:03.791395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7d0d1a60-8139-4dea-a892-fe427427042e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:03.792406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da24f-d23b-4d0a-8703-ca8c0b25f101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:03.795890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da24f-d23b-4d0a-8703-ca8c0b25f101 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:03.798331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da24f-d23b-4d0a-8703-ca8c0b25f101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:03.799495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da24f-d23b-4d0a-8703-ca8c0b25f101 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:03.804381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791da24f-d23b-4d0a-8703-ca8c0b25f101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:03.811910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791da24f-d23b-4d0a-8703-ca8c0b25f101 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:03.854848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1a60-8139-4dea-a892-fe427427042e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:03.862665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d1a60-8139-4dea-a892-fe427427042e service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:03.878820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 874/1763] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:03.881204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560063-2fca-4ebb-8f34-716ff5a3925c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:03.883336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560063-2fca-4ebb-8f34-716ff5a3925c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:03.883741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6560063-2fca-4ebb-8f34-716ff5a3925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:03.921886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 890/1764] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:03.922816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1a60-8139-4dea-a892-fe427427042e service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:03.959804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d1a60-8139-4dea-a892-fe427427042e service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:03.967721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c6560063-2fca-4ebb-8f34-716ff5a3925c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:03.973780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33ba6d-8808-4da1-9baf-6cdd0e7098ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:03.977695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ba6d-8808-4da1-9baf-6cdd0e7098ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:03.977991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ba6d-8808-4da1-9baf-6cdd0e7098ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:03.979373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33ba6d-8808-4da1-9baf-6cdd0e7098ed admin admin] PATH_INFO: `/v3/projects/cb0338cb89154a2698a873c1637ba2ae/users/e9cdc56991164e23b7b9157a7ca55d76/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:03.984229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c6560063-2fca-4ebb-8f34-716ff5a3925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:04.042732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 875/1765] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:04.057764 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560063-2fca-4ebb-8f34-716ff5a3925c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:04.060599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c6560063-2fca-4ebb-8f34-716ff5a3925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:04.062604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33ba6d-8808-4da1-9baf-6cdd0e7098ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0338cb89154a2698a873c1637ba2ae, user_id=e9cdc56991164e23b7b9157a7ca55d76, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:04.079389 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33ba6d-8808-4da1-9baf-6cdd0e7098ed admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:04.127704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 891/1766] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:03 2022] PUT /identity/v3/projects/cb0338cb89154a2698a873c1637ba2ae/users/e9cdc56991164e23b7b9157a7ca55d76/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:04.139694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835098a-caab-4b2d-aa0e-c72804569937 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:04.140227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835098a-caab-4b2d-aa0e-c72804569937 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:04.140654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835098a-caab-4b2d-aa0e-c72804569937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:04.317070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6560063-2fca-4ebb-8f34-716ff5a3925c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:04.352588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0835098a-caab-4b2d-aa0e-c72804569937 None None] MFA Rules not processed for user `e9cdc56991164e23b7b9157a7ca55d76`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:04.364255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0835098a-caab-4b2d-aa0e-c72804569937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:04.492824 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73df23-bc5c-4c14-9591-072fba6bd04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:04.493886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73df23-bc5c-4c14-9591-072fba6bd04f service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:04.494571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73df23-bc5c-4c14-9591-072fba6bd04f service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:04.495251 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73df23-bc5c-4c14-9591-072fba6bd04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:04.712060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 892/1767] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 573 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:04.713213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835098a-caab-4b2d-aa0e-c72804569937 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:04.716309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73df23-bc5c-4c14-9591-072fba6bd04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:04.717757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73df23-bc5c-4c14-9591-072fba6bd04f service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:04.722698 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0835098a-caab-4b2d-aa0e-c72804569937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:04.774220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 876/1768] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:04.777006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73df23-bc5c-4c14-9591-072fba6bd04f service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:04.780828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835098a-caab-4b2d-aa0e-c72804569937 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:04.783222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4a73df23-bc5c-4c14-9591-072fba6bd04f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:04.796208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:04.797185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:04.797509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:04.797747 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] PATH_INFO: `/v3/users/8f99446e95464c34a81fcf3464ad0d09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:04.807240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f99446e95464c34a81fcf3464ad0d09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:04.814394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:04.821519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73df23-bc5c-4c14-9591-072fba6bd04f service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:04.827570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:04.828457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:04.829366 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:04.829704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] PATH_INFO: `/v3/projects/d9ebc59b4c8745f2aaaaba5b0aa10ee3` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:04.831269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ebc59b4c8745f2aaaaba5b0aa10ee3)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:04.841379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:04.935744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f99446e95464c34a81fcf3464ad0d09'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:04.965876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f99446e95464c34a81fcf3464ad0d09'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:04.982394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f99446e95464c34a81fcf3464ad0d09'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:04.983715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f99446e95464c34a81fcf3464ad0d09'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:04.984354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f99446e95464c34a81fcf3464ad0d09'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:05.048967 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 893/1769] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:04 2022] DELETE /identity/v3/users/8f99446e95464c34a81fcf3464ad0d09 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:05.053792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:05.054918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:05.086309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ebc59b4c8745f2aaaaba5b0aa10ee3', 'request_id': 'req-f79a59b8-621b-4439-9073-e444051d41bb'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:05.115423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ebc59b4c8745f2aaaaba5b0aa10ee3', 'request_id': 'req-f79a59b8-621b-4439-9073-e444051d41bb'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:05.145873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ebc59b4c8745f2aaaaba5b0aa10ee3', 'request_id': 'req-f79a59b8-621b-4439-9073-e444051d41bb'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:05.203468 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] The token cache is being invalidate because project d9ebc59b4c8745f2aaaaba5b0aa10ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:05.204927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:05.209220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f79a59b8-621b-4439-9073-e444051d41bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:05.218293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 877/1770] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:04 2022] DELETE /identity/v3/projects/d9ebc59b4c8745f2aaaaba5b0aa10ee3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:05.225367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b01a-3e60-4150-bb90-f08c0ab15819 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:05.229099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b01a-3e60-4150-bb90-f08c0ab15819 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:05.229617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18b01a-3e60-4150-bb90-f08c0ab15819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:05.313278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-8b18b01a-3e60-4150-bb90-f08c0ab15819 None None] MFA Rules not processed for user `b434038833084579adf853df718315b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:05.318182 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8b18b01a-3e60-4150-bb90-f08c0ab15819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:05.322754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb9d8a-0f73-467b-8f6f-1c4ca406e4a1 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:05.334683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8035df-dfcc-457e-ac94-468ade5acfd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:05.338574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8035df-dfcc-457e-ac94-468ade5acfd2 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:05.339738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8035df-dfcc-457e-ac94-468ade5acfd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:05.343102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8035df-dfcc-457e-ac94-468ade5acfd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:05.359976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7d8035df-dfcc-457e-ac94-468ade5acfd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:05.487628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 878/1771] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:05.489384 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804c588-6e23-41ef-9c5b-59459c81816e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:05.489899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804c588-6e23-41ef-9c5b-59459c81816e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:05.490604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804c588-6e23-41ef-9c5b-59459c81816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:05.545858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8035df-dfcc-457e-ac94-468ade5acfd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:05.547880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8035df-dfcc-457e-ac94-468ade5acfd2 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:05.549700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-8804c588-6e23-41ef-9c5b-59459c81816e None None] MFA Rules not processed for user `e548e01902ba41e79667ed56d602f19a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:05.550715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8804c588-6e23-41ef-9c5b-59459c81816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:05.571143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 894/1772] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:05.572685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89edbdf-1b55-4cb7-b5c3-c8911ae8e07b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:05.573137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89edbdf-1b55-4cb7-b5c3-c8911ae8e07b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:05.573457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89edbdf-1b55-4cb7-b5c3-c8911ae8e07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:05.615905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a89edbdf-1b55-4cb7-b5c3-c8911ae8e07b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:05.618877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a89edbdf-1b55-4cb7-b5c3-c8911ae8e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:05.745155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 879/1773] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:05.761431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a03224-6cb0-445c-8e1a-8b91062be8c5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:05.762530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a03224-6cb0-445c-8e1a-8b91062be8c5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:05.763782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a03224-6cb0-445c-8e1a-8b91062be8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:05.781065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 895/1774] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:05.782310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89edbdf-1b55-4cb7-b5c3-c8911ae8e07b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:05.783819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a89edbdf-1b55-4cb7-b5c3-c8911ae8e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:05.810940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-15a03224-6cb0-445c-8e1a-8b91062be8c5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:05.811608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89edbdf-1b55-4cb7-b5c3-c8911ae8e07b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:05.812964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-15a03224-6cb0-445c-8e1a-8b91062be8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:05.825721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:05.826740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:05.827111 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:05.827486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] PATH_INFO: `/v3/users/e9cdc56991164e23b7b9157a7ca55d76` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:05.834307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cdc56991164e23b7b9157a7ca55d76)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:05.836415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:05.898358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 880/1775] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:05.902172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a03224-6cb0-445c-8e1a-8b91062be8c5 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:05.917394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-15a03224-6cb0-445c-8e1a-8b91062be8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:05.965357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cdc56991164e23b7b9157a7ca55d76'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:05.981730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cdc56991164e23b7b9157a7ca55d76'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:06.015963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cdc56991164e23b7b9157a7ca55d76'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:06.016787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cdc56991164e23b7b9157a7ca55d76'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:06.017542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9b99bd52-9b7a-4fa5-9055-990a21752f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cdc56991164e23b7b9157a7ca55d76'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:06.067149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 896/1776] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:05 2022] DELETE /identity/v3/users/e9cdc56991164e23b7b9157a7ca55d76 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:06.072406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca43fd5-c53b-4da0-908f-6e67c56f2769 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:06.079719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca43fd5-c53b-4da0-908f-6e67c56f2769 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:06.079719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca43fd5-c53b-4da0-908f-6e67c56f2769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:06.115612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-7ca43fd5-c53b-4da0-908f-6e67c56f2769 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:06.117485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7ca43fd5-c53b-4da0-908f-6e67c56f2769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:06.159510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a03224-6cb0-445c-8e1a-8b91062be8c5 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:06.281268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 897/1777] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:06.287743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e74ef-3797-4842-9d29-70d174f61a7c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:06.288030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e74ef-3797-4842-9d29-70d174f61a7c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:06.290693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e74ef-3797-4842-9d29-70d174f61a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:06.304746 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fad4-7032-43ea-b784-c5fd9bf5fd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:06.305432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fad4-7032-43ea-b784-c5fd9bf5fd58 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:06.305718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fad4-7032-43ea-b784-c5fd9bf5fd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:06.306262 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6fad4-7032-43ea-b784-c5fd9bf5fd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:06.320439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-59e6fad4-7032-43ea-b784-c5fd9bf5fd58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:06.348275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6fad4-7032-43ea-b784-c5fd9bf5fd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:06.352010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6fad4-7032-43ea-b784-c5fd9bf5fd58 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:06.365575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1a3e74ef-3797-4842-9d29-70d174f61a7c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:06.368121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1a3e74ef-3797-4842-9d29-70d174f61a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:06.387862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 898/1778] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:06.389481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 881/1779] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:06.391466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e74ef-3797-4842-9d29-70d174f61a7c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:06.391664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fad4-7032-43ea-b784-c5fd9bf5fd58 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:06.397531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1a3e74ef-3797-4842-9d29-70d174f61a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:06.421463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6fad4-7032-43ea-b784-c5fd9bf5fd58 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:06.430487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e74ef-3797-4842-9d29-70d174f61a7c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:06.437198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b72aa0-0ddc-4474-9df0-3644019b44c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:06.437911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b72aa0-0ddc-4474-9df0-3644019b44c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:06.438195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b72aa0-0ddc-4474-9df0-3644019b44c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:06.438544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b72aa0-0ddc-4474-9df0-3644019b44c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:06.439282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b72aa0-0ddc-4474-9df0-3644019b44c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:06.439607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b72aa0-0ddc-4474-9df0-3644019b44c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:06.441389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b72aa0-0ddc-4474-9df0-3644019b44c6 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:06.447524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:06.449022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:06.450083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:06.451887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] PATH_INFO: `/v3/projects/a70727cd1f194aba8969c7a0f0818fd4` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:06.453483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a70727cd1f194aba8969c7a0f0818fd4)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:06.458904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:06.476638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 882/1780] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:06.480994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b72aa0-0ddc-4474-9df0-3644019b44c6 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:06.496652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b72aa0-0ddc-4474-9df0-3644019b44c6 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:06.511802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be535066-6e6e-4509-a407-59721b40cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:06.512666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be535066-6e6e-4509-a407-59721b40cdcc admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:06.512985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be535066-6e6e-4509-a407-59721b40cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:06.514156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be535066-6e6e-4509-a407-59721b40cdcc admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:06.515092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be535066-6e6e-4509-a407-59721b40cdcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:06.517039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be535066-6e6e-4509-a407-59721b40cdcc admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:06.601049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a70727cd1f194aba8969c7a0f0818fd4', 'request_id': 'req-187d71c3-93b8-47d7-a042-5568d4073924'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:06.611486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a70727cd1f194aba8969c7a0f0818fd4', 'request_id': 'req-187d71c3-93b8-47d7-a042-5568d4073924'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:06.622529 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a70727cd1f194aba8969c7a0f0818fd4', 'request_id': 'req-187d71c3-93b8-47d7-a042-5568d4073924'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:06.631943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 883/1781] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:06 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:06.633136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be535066-6e6e-4509-a407-59721b40cdcc admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:06.635157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-be535066-6e6e-4509-a407-59721b40cdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:06.649086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] The token cache is being invalidate because project a70727cd1f194aba8969c7a0f0818fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:06.652225 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:06.654790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:06.659476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 899/1782] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:06 2022] DELETE /identity/v3/projects/a70727cd1f194aba8969c7a0f0818fd4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:06.661974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:06.666015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:06.752551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d71c3-93b8-47d7-a042-5568d4073924 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:06.800411 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be535066-6e6e-4509-a407-59721b40cdcc admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:06.807377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:06.808501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:06.808897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:06.809291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:06.811522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:06.891410 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:06.893219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:06.905972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 884/1783] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:06.906808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:06.908962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:06.923676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b92224-1577-4757-99ad-0b1cde05100c service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:06.931620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:06.933598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:06.934145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:06.934636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] PATH_INFO: `/v3/users/cef1f53b4f8f464685b547437f231659` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:06.936650 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef1f53b4f8f464685b547437f231659)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:06.939227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:07.044692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef1f53b4f8f464685b547437f231659'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:07.056630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de9ea-677c-4ede-8764-ce93852426ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:07.057432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de9ea-677c-4ede-8764-ce93852426ca admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:07.057645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de9ea-677c-4ede-8764-ce93852426ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:07.057974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de9ea-677c-4ede-8764-ce93852426ca admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:07.058738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462de9ea-677c-4ede-8764-ce93852426ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:07.060781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462de9ea-677c-4ede-8764-ce93852426ca admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:07.073796 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef1f53b4f8f464685b547437f231659'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:07.092725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef1f53b4f8f464685b547437f231659'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:07.093550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef1f53b4f8f464685b547437f231659'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:07.094386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef1f53b4f8f464685b547437f231659'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:07.124587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 900/1784] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:06 2022] POST /identity/v3/users => generated 293 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:07.138561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de9ea-677c-4ede-8764-ce93852426ca admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:07.141041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-462de9ea-677c-4ede-8764-ce93852426ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:07.155313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 885/1785] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:06 2022] DELETE /identity/v3/users/cef1f53b4f8f464685b547437f231659 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:07.206186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de9ea-677c-4ede-8764-ce93852426ca admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:07.402467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187c023-5e36-44d5-a8f6-80edaadd6722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:07.403110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187c023-5e36-44d5-a8f6-80edaadd6722 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:07.403401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187c023-5e36-44d5-a8f6-80edaadd6722 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:07.403798 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187c023-5e36-44d5-a8f6-80edaadd6722 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:07.404567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187c023-5e36-44d5-a8f6-80edaadd6722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:07.409024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187c023-5e36-44d5-a8f6-80edaadd6722 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:07.468066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 901/1786] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:07.472355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:07.504069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dbd1c-e028-4c03-97fd-eb005908db6d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:07.527002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a97c27-840c-4f15-99dd-1f689a5ff6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:07.532212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97c27-840c-4f15-99dd-1f689a5ff6ec admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:07.532533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97c27-840c-4f15-99dd-1f689a5ff6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:07.532824 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a97c27-840c-4f15-99dd-1f689a5ff6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:07.534955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a97c27-840c-4f15-99dd-1f689a5ff6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:07.541370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a97c27-840c-4f15-99dd-1f689a5ff6ec admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:07.579771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187c023-5e36-44d5-a8f6-80edaadd6722 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:07.587104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 886/1787] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:07.591946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187c023-5e36-44d5-a8f6-80edaadd6722 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:07.619633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eabbf8-7013-4dca-8c24-d59975eb3701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:07.622522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eabbf8-7013-4dca-8c24-d59975eb3701 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:07.624449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eabbf8-7013-4dca-8c24-d59975eb3701 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:07.626051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eabbf8-7013-4dca-8c24-d59975eb3701 admin admin] PATH_INFO: `/v3/projects/7064d0546e694f3da0860b61cefe8185/users/f5de569162f6494d90fc6e61d5ca3a9a/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:07.696635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eabbf8-7013-4dca-8c24-d59975eb3701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7064d0546e694f3da0860b61cefe8185, user_id=f5de569162f6494d90fc6e61d5ca3a9a, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:07.708872 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eabbf8-7013-4dca-8c24-d59975eb3701 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:07.757298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 902/1788] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:07 2022] PUT /identity/v3/projects/7064d0546e694f3da0860b61cefe8185/users/f5de569162f6494d90fc6e61d5ca3a9a/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:07.760457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd725e-4bb8-48fe-843a-f38d00907c23 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:07.760457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd725e-4bb8-48fe-843a-f38d00907c23 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:07.760457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd725e-4bb8-48fe-843a-f38d00907c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:07.810345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6acd725e-4bb8-48fe-843a-f38d00907c23 None None] MFA Rules not processed for user `f5de569162f6494d90fc6e61d5ca3a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:07.811620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6acd725e-4bb8-48fe-843a-f38d00907c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:08.004932 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 887/1789] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:08.009194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eabbf8-7013-4dca-8c24-d59975eb3701 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:08.118154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eabbf8-7013-4dca-8c24-d59975eb3701 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:08.140784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3708-3248-4889-8396-6e24a6de4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:08.141671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3708-3248-4889-8396-6e24a6de4160 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:08.142107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3708-3248-4889-8396-6e24a6de4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:08.142544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3708-3248-4889-8396-6e24a6de4160 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:08.143545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb3708-3248-4889-8396-6e24a6de4160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:08.155511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb3708-3248-4889-8396-6e24a6de4160 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:08.225267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 903/1790] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:08 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:08.229187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd725e-4bb8-48fe-843a-f38d00907c23 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:08.243024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd725e-4bb8-48fe-843a-f38d00907c23 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:08.304787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf916f2-90ac-43a4-9fbe-91af08e2b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:08.305781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf916f2-90ac-43a4-9fbe-91af08e2b176 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:08.306179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf916f2-90ac-43a4-9fbe-91af08e2b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:08.306608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf916f2-90ac-43a4-9fbe-91af08e2b176 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:08.307417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf916f2-90ac-43a4-9fbe-91af08e2b176 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:08.309466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf916f2-90ac-43a4-9fbe-91af08e2b176 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:08.338926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 888/1791] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:08 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:08.340949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3708-3248-4889-8396-6e24a6de4160 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:08.361150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3708-3248-4889-8396-6e24a6de4160 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:08.367785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c57b14-ab25-4881-a651-de68efc03c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:08.368689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c57b14-ab25-4881-a651-de68efc03c43 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:08.368984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c57b14-ab25-4881-a651-de68efc03c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:08.369259 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c57b14-ab25-4881-a651-de68efc03c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:08.370138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c57b14-ab25-4881-a651-de68efc03c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:08.371830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c57b14-ab25-4881-a651-de68efc03c43 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:08.390654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 904/1792] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:08.394094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf916f2-90ac-43a4-9fbe-91af08e2b176 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:08.426736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf916f2-90ac-43a4-9fbe-91af08e2b176 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:08.433755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf297e-d1a9-4e29-9278-df54c8f4256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:08.435442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf297e-d1a9-4e29-9278-df54c8f4256f admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:08.437533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf297e-d1a9-4e29-9278-df54c8f4256f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:08.438063 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf297e-d1a9-4e29-9278-df54c8f4256f admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:08.439274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf297e-d1a9-4e29-9278-df54c8f4256f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:08.441365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf297e-d1a9-4e29-9278-df54c8f4256f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:08.460658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c57b14-ab25-4881-a651-de68efc03c43 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:08.462332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 889/1793] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:08.473397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c57b14-ab25-4881-a651-de68efc03c43 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:08.484696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b2bd4-a7f5-4601-ba6f-28207848d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:08.485976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b2bd4-a7f5-4601-ba6f-28207848d907 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:08.486569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b2bd4-a7f5-4601-ba6f-28207848d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:08.486856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b2bd4-a7f5-4601-ba6f-28207848d907 admin admin] PATH_INFO: `/v3/projects/74720c5cfeac40e5b21a485ad136e44d/users/ae40d52eda054deb9ee8dbeb2d26163e/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:08.511257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b2bd4-a7f5-4601-ba6f-28207848d907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74720c5cfeac40e5b21a485ad136e44d, user_id=ae40d52eda054deb9ee8dbeb2d26163e, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:08.518824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b2bd4-a7f5-4601-ba6f-28207848d907 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:08.536512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 905/1794] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:08 2022] PUT /identity/v3/projects/74720c5cfeac40e5b21a485ad136e44d/users/ae40d52eda054deb9ee8dbeb2d26163e/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:08.550082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea14dc7-075d-4b9e-aed1-0262e0c8be34 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:08.550683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea14dc7-075d-4b9e-aed1-0262e0c8be34 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:08.550762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea14dc7-075d-4b9e-aed1-0262e0c8be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:08.586130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-1ea14dc7-075d-4b9e-aed1-0262e0c8be34 None None] MFA Rules not processed for user `ae40d52eda054deb9ee8dbeb2d26163e`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:08.588085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-1ea14dc7-075d-4b9e-aed1-0262e0c8be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:08.734378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 890/1795] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:08.737494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b2bd4-a7f5-4601-ba6f-28207848d907 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:08.755263 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea14dc7-075d-4b9e-aed1-0262e0c8be34 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:08.758026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-1ea14dc7-075d-4b9e-aed1-0262e0c8be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:08.836852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b2bd4-a7f5-4601-ba6f-28207848d907 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:08.851777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3164a4-d862-4c3c-bc5d-0db667f5ba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:08.851777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3164a4-d862-4c3c-bc5d-0db667f5ba8e admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:08.851777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3164a4-d862-4c3c-bc5d-0db667f5ba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:08.852130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3164a4-d862-4c3c-bc5d-0db667f5ba8e admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:08.852648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3164a4-d862-4c3c-bc5d-0db667f5ba8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:08.859318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3164a4-d862-4c3c-bc5d-0db667f5ba8e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:08.905620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea14dc7-075d-4b9e-aed1-0262e0c8be34 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:08.917211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:08.918159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:08.918493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:08.918767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] PATH_INFO: `/v3/projects/838379d3d4634b25b49af9f398275792` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:08.922700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838379d3d4634b25b49af9f398275792)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:08.926672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:08.929324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 906/1796] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:08 2022] POST /identity/v3/projects => generated 387 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:08.933205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3164a4-d862-4c3c-bc5d-0db667f5ba8e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:08.936054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1b3164a4-d862-4c3c-bc5d-0db667f5ba8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:09.020965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838379d3d4634b25b49af9f398275792', 'request_id': 'req-a9b7eefe-93d9-49a0-a108-4170fd203295'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.030934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838379d3d4634b25b49af9f398275792', 'request_id': 'req-a9b7eefe-93d9-49a0-a108-4170fd203295'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.053536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838379d3d4634b25b49af9f398275792', 'request_id': 'req-a9b7eefe-93d9-49a0-a108-4170fd203295'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.096369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] The token cache is being invalidate because project 838379d3d4634b25b49af9f398275792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:09.096680 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.098498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.110471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 891/1797] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:08 2022] DELETE /identity/v3/projects/838379d3d4634b25b49af9f398275792 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:09.112732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:09.117451 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:09.139874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3164a4-d862-4c3c-bc5d-0db667f5ba8e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:09.313128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:09.314404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:09.314843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:09.316502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] PATH_INFO: `/v3/projects/cb0338cb89154a2698a873c1637ba2ae` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:09.318139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0338cb89154a2698a873c1637ba2ae)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:09.320379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:09.324618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7eefe-93d9-49a0-a108-4170fd203295 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:09.343723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520011-bafa-4928-8565-6ce6268d2cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:09.344423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520011-bafa-4928-8565-6ce6268d2cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:09.344706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520011-bafa-4928-8565-6ce6268d2cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:09.344981 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69520011-bafa-4928-8565-6ce6268d2cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:09.345852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69520011-bafa-4928-8565-6ce6268d2cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:09.347845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69520011-bafa-4928-8565-6ce6268d2cc5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:09.402222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 892/1798] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:09 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:09.403433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520011-bafa-4928-8565-6ce6268d2cc5 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:09.415445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-69520011-bafa-4928-8565-6ce6268d2cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:09.430643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69520011-bafa-4928-8565-6ce6268d2cc5 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:09.441638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:09.442977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:09.443265 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:09.443541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] PATH_INFO: `/v3/users/82295aa3b2a04be588a60c3538b34e34` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:09.459593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82295aa3b2a04be588a60c3538b34e34)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:09.464543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:09.542078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82295aa3b2a04be588a60c3538b34e34'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.554558 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82295aa3b2a04be588a60c3538b34e34'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.569905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82295aa3b2a04be588a60c3538b34e34'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.570936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82295aa3b2a04be588a60c3538b34e34'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.572534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82295aa3b2a04be588a60c3538b34e34'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.594951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 893/1799] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:09 2022] DELETE /identity/v3/users/82295aa3b2a04be588a60c3538b34e34 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:09.596680 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:09.598952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:09.613738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0338cb89154a2698a873c1637ba2ae', 'request_id': 'req-776faf20-d5a3-4b85-9982-242fc4b0a19c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.638072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0338cb89154a2698a873c1637ba2ae', 'request_id': 'req-776faf20-d5a3-4b85-9982-242fc4b0a19c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.673394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981f3e7-e127-43d7-9511-ab2a1feb7e81 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:09.676989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0338cb89154a2698a873c1637ba2ae', 'request_id': 'req-776faf20-d5a3-4b85-9982-242fc4b0a19c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.679306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:09.682848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:09.683154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:09.683469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] PATH_INFO: `/v3/projects/36438e6a2abb477c95a90fc7d5f3f053` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:09.686117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36438e6a2abb477c95a90fc7d5f3f053)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:09.689091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:09.730452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] The token cache is being invalidate because project cb0338cb89154a2698a873c1637ba2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:09.731560 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.733757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.735877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 907/1800] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:08 2022] DELETE /identity/v3/projects/cb0338cb89154a2698a873c1637ba2ae => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:09.737346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:09.740882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:09.806555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36438e6a2abb477c95a90fc7d5f3f053', 'request_id': 'req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.820174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36438e6a2abb477c95a90fc7d5f3f053', 'request_id': 'req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.837691 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36438e6a2abb477c95a90fc7d5f3f053', 'request_id': 'req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.861842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] The token cache is being invalidate because project 36438e6a2abb477c95a90fc7d5f3f053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:09.862130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.863278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b35cd2ec-493a-41a4-b7f0-b2f0b8b8f22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:09.873022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 894/1801] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:09 2022] DELETE /identity/v3/projects/36438e6a2abb477c95a90fc7d5f3f053 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:09.873022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cef46-5cb4-4992-aef6-611689c97128 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:09.873022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cef46-5cb4-4992-aef6-611689c97128 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:09.874727 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cef46-5cb4-4992-aef6-611689c97128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:09.893945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776faf20-d5a3-4b85-9982-242fc4b0a19c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:09.921141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c67cef46-5cb4-4992-aef6-611689c97128 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:09.923066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c67cef46-5cb4-4992-aef6-611689c97128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:09.998214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 895/1802] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:09.999821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156545d-ab57-4bd6-85a7-72075e35cc82 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.000115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156545d-ab57-4bd6-85a7-72075e35cc82 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.000393 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156545d-ab57-4bd6-85a7-72075e35cc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.008943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d9382-1675-4d2e-9e1d-450b795237e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.009256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9382-1675-4d2e-9e1d-450b795237e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.009541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9382-1675-4d2e-9e1d-450b795237e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.009912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9382-1675-4d2e-9e1d-450b795237e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.011136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d9382-1675-4d2e-9e1d-450b795237e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.013364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d9382-1675-4d2e-9e1d-450b795237e3 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.034190 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 908/1803] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:10.037303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426367e-8888-48df-a024-31df8c415a3d None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.037646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426367e-8888-48df-a024-31df8c415a3d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.037927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426367e-8888-48df-a024-31df8c415a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.042674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5156545d-ab57-4bd6-85a7-72075e35cc82 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:10.049091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5156545d-ab57-4bd6-85a7-72075e35cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.059091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5426367e-8888-48df-a024-31df8c415a3d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:10.060300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5426367e-8888-48df-a024-31df8c415a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.068815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 896/1804] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:10.069266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 909/1805] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:10.073330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426367e-8888-48df-a024-31df8c415a3d None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.074223 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156545d-ab57-4bd6-85a7-72075e35cc82 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.079675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5156545d-ab57-4bd6-85a7-72075e35cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.084062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426367e-8888-48df-a024-31df8c415a3d None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.094428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c4384-4112-480e-8005-7df953838eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.095119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c4384-4112-480e-8005-7df953838eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.095407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c4384-4112-480e-8005-7df953838eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.095685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c4384-4112-480e-8005-7df953838eb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.096859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c4384-4112-480e-8005-7df953838eb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:10.096859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c4384-4112-480e-8005-7df953838eb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.099406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c4384-4112-480e-8005-7df953838eb3 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.102084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156545d-ab57-4bd6-85a7-72075e35cc82 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.112040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf0b51-4b26-42fd-bd88-e6b256c12e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.112995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf0b51-4b26-42fd-bd88-e6b256c12e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.113243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf0b51-4b26-42fd-bd88-e6b256c12e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.113509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf0b51-4b26-42fd-bd88-e6b256c12e12 admin admin] PATH_INFO: `/v3/projects/27b210a5a7a94e08a0a519dcc2e26213/users/80aa8a4499a8452f9dbad62cae45e7d7/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.127727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 910/1806] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:26:10.133523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80654c3-fd14-4ded-b8d5-dd5d196dd6e3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.134130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80654c3-fd14-4ded-b8d5-dd5d196dd6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.134738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80654c3-fd14-4ded-b8d5-dd5d196dd6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.148192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf0b51-4b26-42fd-bd88-e6b256c12e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b210a5a7a94e08a0a519dcc2e26213, user_id=80aa8a4499a8452f9dbad62cae45e7d7, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.152143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf0b51-4b26-42fd-bd88-e6b256c12e12 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.166777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c80654c3-fd14-4ded-b8d5-dd5d196dd6e3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:10.168181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c80654c3-fd14-4ded-b8d5-dd5d196dd6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.174172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 897/1807] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:10 2022] PUT /identity/v3/projects/27b210a5a7a94e08a0a519dcc2e26213/users/80aa8a4499a8452f9dbad62cae45e7d7/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:10.174172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf0b51-4b26-42fd-bd88-e6b256c12e12 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.252687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf0b51-4b26-42fd-bd88-e6b256c12e12 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.254419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 911/1808] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:10.258811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98acce-37f1-45cc-9d6a-7e852061c263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.259252 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80654c3-fd14-4ded-b8d5-dd5d196dd6e3 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.259981 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98acce-37f1-45cc-9d6a-7e852061c263 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.260477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98acce-37f1-45cc-9d6a-7e852061c263 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.260883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c80654c3-fd14-4ded-b8d5-dd5d196dd6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.261135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98acce-37f1-45cc-9d6a-7e852061c263 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.262016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98acce-37f1-45cc-9d6a-7e852061c263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.264200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98acce-37f1-45cc-9d6a-7e852061c263 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.273435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80654c3-fd14-4ded-b8d5-dd5d196dd6e3 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.281569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.282594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.282881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.283211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] PATH_INFO: `/v3/projects/f99d3f5604d9457da7fc306ad75c36a4` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.284503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99d3f5604d9457da7fc306ad75c36a4)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.287130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.295492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 898/1809] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:10.295492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98acce-37f1-45cc-9d6a-7e852061c263 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.333877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99d3f5604d9457da7fc306ad75c36a4', 'request_id': 'req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:10.341136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99d3f5604d9457da7fc306ad75c36a4', 'request_id': 'req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:10.347187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99d3f5604d9457da7fc306ad75c36a4', 'request_id': 'req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:10.358418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98acce-37f1-45cc-9d6a-7e852061c263 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.363582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] The token cache is being invalidate because project f99d3f5604d9457da7fc306ad75c36a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:10.363871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:10.364556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:10.366124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 912/1810] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:10 2022] DELETE /identity/v3/projects/f99d3f5604d9457da7fc306ad75c36a4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:10.366914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.368171 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.412653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ec80-f997-4eb0-9c1b-f7d18f373929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.413329 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ec80-f997-4eb0-9c1b-f7d18f373929 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.413608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ec80-f997-4eb0-9c1b-f7d18f373929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.413880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ec80-f997-4eb0-9c1b-f7d18f373929 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.414625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6ec80-f997-4eb0-9c1b-f7d18f373929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.416204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6ec80-f997-4eb0-9c1b-f7d18f373929 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.425859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 899/1811] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:10.426803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ec80-f997-4eb0-9c1b-f7d18f373929 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.428519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bbd6ec80-f997-4eb0-9c1b-f7d18f373929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.431289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7723a-ecd9-4304-ab5c-275b4ef1b96c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.435922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f685f37-80a5-4c9d-a0dc-9a0414f39044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.436575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685f37-80a5-4c9d-a0dc-9a0414f39044 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.436856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685f37-80a5-4c9d-a0dc-9a0414f39044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.437130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f685f37-80a5-4c9d-a0dc-9a0414f39044 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.437846 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f685f37-80a5-4c9d-a0dc-9a0414f39044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:10.438148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f685f37-80a5-4c9d-a0dc-9a0414f39044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.439883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f685f37-80a5-4c9d-a0dc-9a0414f39044 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.440494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ec80-f997-4eb0-9c1b-f7d18f373929 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.447093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0baed3-b0d6-4513-9f16-ea53793de791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.447750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0baed3-b0d6-4513-9f16-ea53793de791 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.448035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0baed3-b0d6-4513-9f16-ea53793de791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.448311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0baed3-b0d6-4513-9f16-ea53793de791 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.448982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0baed3-b0d6-4513-9f16-ea53793de791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.450934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0baed3-b0d6-4513-9f16-ea53793de791 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.452545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 913/1812] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:10.453802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccb87e-b4ca-4b2b-8a4b-5092905902a1 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.454094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccb87e-b4ca-4b2b-8a4b-5092905902a1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.454421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccb87e-b4ca-4b2b-8a4b-5092905902a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.473389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 900/1813] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:10.474226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-06ccb87e-b4ca-4b2b-8a4b-5092905902a1 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:10.474905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0baed3-b0d6-4513-9f16-ea53793de791 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.475354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-06ccb87e-b4ca-4b2b-8a4b-5092905902a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.476486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8c0baed3-b0d6-4513-9f16-ea53793de791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.489621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 914/1814] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:10.490496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0baed3-b0d6-4513-9f16-ea53793de791 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.492288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccb87e-b4ca-4b2b-8a4b-5092905902a1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.492431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4d075-b0d4-478c-9b8a-e333fa03cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.493309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4d075-b0d4-478c-9b8a-e333fa03cd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.493593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4d075-b0d4-478c-9b8a-e333fa03cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.493866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4d075-b0d4-478c-9b8a-e333fa03cd6f admin admin] PATH_INFO: `/v3/projects/27b210a5a7a94e08a0a519dcc2e26213/users/80aa8a4499a8452f9dbad62cae45e7d7/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.495953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4d075-b0d4-478c-9b8a-e333fa03cd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b210a5a7a94e08a0a519dcc2e26213, user_id=80aa8a4499a8452f9dbad62cae45e7d7, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.498602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4d075-b0d4-478c-9b8a-e333fa03cd6f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.501809 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccb87e-b4ca-4b2b-8a4b-5092905902a1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.507218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b1716e-77a3-4a11-ac0a-df7d57093822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.507883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1716e-77a3-4a11-ac0a-df7d57093822 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.508212 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1716e-77a3-4a11-ac0a-df7d57093822 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.508442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1716e-77a3-4a11-ac0a-df7d57093822 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.509895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1716e-77a3-4a11-ac0a-df7d57093822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.511971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b1716e-77a3-4a11-ac0a-df7d57093822 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.512098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 901/1815] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:10 2022] PUT /identity/v3/projects/27b210a5a7a94e08a0a519dcc2e26213/users/80aa8a4499a8452f9dbad62cae45e7d7/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:10.515344 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4d075-b0d4-478c-9b8a-e333fa03cd6f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.553190 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 915/1816] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:10.554727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f25e53-dd8c-45df-9d6d-583e0ecf2ea9 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.555100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f25e53-dd8c-45df-9d6d-583e0ecf2ea9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.555588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f25e53-dd8c-45df-9d6d-583e0ecf2ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.573802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-69f25e53-dd8c-45df-9d6d-583e0ecf2ea9 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:10.575098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-69f25e53-dd8c-45df-9d6d-583e0ecf2ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.592179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4d075-b0d4-478c-9b8a-e333fa03cd6f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.633837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 916/1817] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:10.635157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb67c-dbbc-43ce-aa7b-4a9cb7350f05 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.635610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb67c-dbbc-43ce-aa7b-4a9cb7350f05 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.635895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9eb67c-dbbc-43ce-aa7b-4a9cb7350f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.647382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df26db-1d0a-4843-a48f-88d6833f837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.648058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df26db-1d0a-4843-a48f-88d6833f837d admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.648341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df26db-1d0a-4843-a48f-88d6833f837d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.648617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df26db-1d0a-4843-a48f-88d6833f837d admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.649339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df26db-1d0a-4843-a48f-88d6833f837d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.650973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df26db-1d0a-4843-a48f-88d6833f837d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.660952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 902/1818] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:10.662326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df26db-1d0a-4843-a48f-88d6833f837d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.663470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-de9eb67c-dbbc-43ce-aa7b-4a9cb7350f05 None None] MFA Rules not processed for user `80aa8a4499a8452f9dbad62cae45e7d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:10.664658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-de9eb67c-dbbc-43ce-aa7b-4a9cb7350f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.673738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df26db-1d0a-4843-a48f-88d6833f837d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.678774 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715febe7-6624-4bb8-a11f-f03df63992f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.679441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715febe7-6624-4bb8-a11f-f03df63992f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.679746 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715febe7-6624-4bb8-a11f-f03df63992f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.680057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715febe7-6624-4bb8-a11f-f03df63992f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.680790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715febe7-6624-4bb8-a11f-f03df63992f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.682759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715febe7-6624-4bb8-a11f-f03df63992f1 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.703112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 903/1819] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:10.703757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715febe7-6624-4bb8-a11f-f03df63992f1 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.713392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715febe7-6624-4bb8-a11f-f03df63992f1 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.717965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a83a-d667-4c4c-a9cc-cfd674337804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.718623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a83a-d667-4c4c-a9cc-cfd674337804 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.718971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a83a-d667-4c4c-a9cc-cfd674337804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.719179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0a83a-d667-4c4c-a9cc-cfd674337804 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.719880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a83a-d667-4c4c-a9cc-cfd674337804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:10.720179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a83a-d667-4c4c-a9cc-cfd674337804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.721735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0a83a-d667-4c4c-a9cc-cfd674337804 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.732179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 917/1820] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:10.733255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eb67c-dbbc-43ce-aa7b-4a9cb7350f05 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.733790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 904/1821] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:10.734582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a83a-d667-4c4c-a9cc-cfd674337804 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.745366 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0a83a-d667-4c4c-a9cc-cfd674337804 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.748107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9eb67c-dbbc-43ce-aa7b-4a9cb7350f05 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.750088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc5170-20ed-4a90-a1f0-1f593e3b8fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.750786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc5170-20ed-4a90-a1f0-1f593e3b8fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.751070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc5170-20ed-4a90-a1f0-1f593e3b8fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.751346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc5170-20ed-4a90-a1f0-1f593e3b8fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.752059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc5170-20ed-4a90-a1f0-1f593e3b8fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.752691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775ec5-31b3-41aa-81b6-a58e575d5ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.753339 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775ec5-31b3-41aa-81b6-a58e575d5ebe admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.753620 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775ec5-31b3-41aa-81b6-a58e575d5ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.753723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc5170-20ed-4a90-a1f0-1f593e3b8fd7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.753897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0775ec5-31b3-41aa-81b6-a58e575d5ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.754636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775ec5-31b3-41aa-81b6-a58e575d5ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.756317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0775ec5-31b3-41aa-81b6-a58e575d5ebe admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.766823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 905/1822] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:10.766823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc5170-20ed-4a90-a1f0-1f593e3b8fd7 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.767041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 918/1823] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:10.767041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775ec5-31b3-41aa-81b6-a58e575d5ebe admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.770089 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d0775ec5-31b3-41aa-81b6-a58e575d5ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:10.774488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc5170-20ed-4a90-a1f0-1f593e3b8fd7 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.779277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2c558-503c-4039-8cd5-77b4784b214f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.779910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2c558-503c-4039-8cd5-77b4784b214f admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.780197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2c558-503c-4039-8cd5-77b4784b214f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.780468 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2c558-503c-4039-8cd5-77b4784b214f admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.781138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2c558-503c-4039-8cd5-77b4784b214f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.783023 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2c558-503c-4039-8cd5-77b4784b214f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.808674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 906/1824] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:10.809485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2c558-503c-4039-8cd5-77b4784b214f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.828611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0775ec5-31b3-41aa-81b6-a58e575d5ebe admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.869267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2c558-503c-4039-8cd5-77b4784b214f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.874767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1072c2-1692-4500-ae7a-c6bdd3a5da5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.875477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1072c2-1692-4500-ae7a-c6bdd3a5da5c admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.875715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1072c2-1692-4500-ae7a-c6bdd3a5da5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.875994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1072c2-1692-4500-ae7a-c6bdd3a5da5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.876098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c965bd-82d3-4fec-a414-eaff23444c1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.876721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1072c2-1692-4500-ae7a-c6bdd3a5da5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.876831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c965bd-82d3-4fec-a414-eaff23444c1a service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.877116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c965bd-82d3-4fec-a414-eaff23444c1a service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.877275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c965bd-82d3-4fec-a414-eaff23444c1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.878333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1072c2-1692-4500-ae7a-c6bdd3a5da5c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.888737 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 907/1825] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:10.892637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1072c2-1692-4500-ae7a-c6bdd3a5da5c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.903326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1072c2-1692-4500-ae7a-c6bdd3a5da5c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:10.908628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a0f57-876f-4e2c-8e82-e7777f35b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:10.909521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a0f57-876f-4e2c-8e82-e7777f35b111 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:10.909848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a0f57-876f-4e2c-8e82-e7777f35b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:10.910138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a0f57-876f-4e2c-8e82-e7777f35b111 admin admin] PATH_INFO: `/v3/projects/7d7cb62249d84cecb0a78cff06d0af1f/users/3cbd43ad4742441e8fb4f95154d09a22/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:10.927638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a0f57-876f-4e2c-8e82-e7777f35b111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7cb62249d84cecb0a78cff06d0af1f, user_id=3cbd43ad4742441e8fb4f95154d09a22, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.931030 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a0f57-876f-4e2c-8e82-e7777f35b111 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.948097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 908/1826] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:10 2022] PUT /identity/v3/projects/7d7cb62249d84cecb0a78cff06d0af1f/users/3cbd43ad4742441e8fb4f95154d09a22/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:10.949340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a0f57-876f-4e2c-8e82-e7777f35b111 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.954544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c965bd-82d3-4fec-a414-eaff23444c1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:10.955981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c965bd-82d3-4fec-a414-eaff23444c1a service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:10.968308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 919/1827] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:10.969329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c965bd-82d3-4fec-a414-eaff23444c1a service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:10.980723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c965bd-82d3-4fec-a414-eaff23444c1a service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.054942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a0f57-876f-4e2c-8e82-e7777f35b111 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.059534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd37d5-8f7d-4b3a-a1a1-9314d64e0fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.060739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd37d5-8f7d-4b3a-a1a1-9314d64e0fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.061004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd37d5-8f7d-4b3a-a1a1-9314d64e0fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.061328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd37d5-8f7d-4b3a-a1a1-9314d64e0fc9 admin admin] PATH_INFO: `/v3/projects/d074a30183d14c64a22296d1bb39b0d1/users/e9e971ad42cd4519af8d79228ae4c253/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.061557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473cf62-3d5e-4568-9a26-b7eb5ad2547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.062508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473cf62-3d5e-4568-9a26-b7eb5ad2547e admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.062864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473cf62-3d5e-4568-9a26-b7eb5ad2547e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.063240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473cf62-3d5e-4568-9a26-b7eb5ad2547e admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.064121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473cf62-3d5e-4568-9a26-b7eb5ad2547e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.066429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473cf62-3d5e-4568-9a26-b7eb5ad2547e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.079030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd37d5-8f7d-4b3a-a1a1-9314d64e0fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d074a30183d14c64a22296d1bb39b0d1, user_id=e9e971ad42cd4519af8d79228ae4c253, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.082072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd37d5-8f7d-4b3a-a1a1-9314d64e0fc9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.092674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 909/1828] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:10 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:11.096884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b028e2-c2ee-4d93-8bab-f3152bc5fe9f None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.097208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b028e2-c2ee-4d93-8bab-f3152bc5fe9f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.097499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b028e2-c2ee-4d93-8bab-f3152bc5fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.103335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 920/1829] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:10 2022] PUT /identity/v3/projects/d074a30183d14c64a22296d1bb39b0d1/users/e9e971ad42cd4519af8d79228ae4c253/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:11.104169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd37d5-8f7d-4b3a-a1a1-9314d64e0fc9 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.127186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a0b028e2-c2ee-4d93-8bab-f3152bc5fe9f None None] MFA Rules not processed for user `3cbd43ad4742441e8fb4f95154d09a22`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:11.128583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a0b028e2-c2ee-4d93-8bab-f3152bc5fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:11.178656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd37d5-8f7d-4b3a-a1a1-9314d64e0fc9 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.183435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e2ba4-758d-42d5-97dc-bdc410745072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.184218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e2ba4-758d-42d5-97dc-bdc410745072 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.184509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e2ba4-758d-42d5-97dc-bdc410745072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.184788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e2ba4-758d-42d5-97dc-bdc410745072 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.185560 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e2ba4-758d-42d5-97dc-bdc410745072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.187326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e2ba4-758d-42d5-97dc-bdc410745072 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.199907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 921/1830] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:11.204174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 910/1831] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:11.204295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de320724-cac2-46b3-8287-7e15f42bf01c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.204295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de320724-cac2-46b3-8287-7e15f42bf01c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.204295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de320724-cac2-46b3-8287-7e15f42bf01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.204485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b028e2-c2ee-4d93-8bab-f3152bc5fe9f None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.214803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b028e2-c2ee-4d93-8bab-f3152bc5fe9f None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.219491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6024dbc-e03b-4efc-a01d-d09e944d0bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.220167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6024dbc-e03b-4efc-a01d-d09e944d0bba admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.220453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6024dbc-e03b-4efc-a01d-d09e944d0bba admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.220732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6024dbc-e03b-4efc-a01d-d09e944d0bba admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.221455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6024dbc-e03b-4efc-a01d-d09e944d0bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.223093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6024dbc-e03b-4efc-a01d-d09e944d0bba admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.231697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-de320724-cac2-46b3-8287-7e15f42bf01c None None] MFA Rules not processed for user `e9e971ad42cd4519af8d79228ae4c253`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:11.232935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-de320724-cac2-46b3-8287-7e15f42bf01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:11.242288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 911/1832] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:11.242288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6024dbc-e03b-4efc-a01d-d09e944d0bba admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.252077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6024dbc-e03b-4efc-a01d-d09e944d0bba admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.259534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20014e-0c09-4e17-9cb4-ea7b7ac5fee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.260246 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20014e-0c09-4e17-9cb4-ea7b7ac5fee8 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.260463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20014e-0c09-4e17-9cb4-ea7b7ac5fee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.260736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20014e-0c09-4e17-9cb4-ea7b7ac5fee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.261455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20014e-0c09-4e17-9cb4-ea7b7ac5fee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.263596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20014e-0c09-4e17-9cb4-ea7b7ac5fee8 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.291392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 912/1833] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:11.292511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20014e-0c09-4e17-9cb4-ea7b7ac5fee8 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.302422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 922/1834] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:11.303417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de320724-cac2-46b3-8287-7e15f42bf01c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.316759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de320724-cac2-46b3-8287-7e15f42bf01c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.362545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20014e-0c09-4e17-9cb4-ea7b7ac5fee8 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.368825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974ee47-2640-4547-83fa-4b14fdce5c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.369859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ee47-2640-4547-83fa-4b14fdce5c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.370225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ee47-2640-4547-83fa-4b14fdce5c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.370620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ee47-2640-4547-83fa-4b14fdce5c76 admin admin] PATH_INFO: `/v3/projects/ef5ecc3caead4bafa0eb482f7bfcbb8d/users/db7829885dc947c0ac37a7a0c653c67a/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.378090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b3b0-0d30-4931-b4a5-69831a13db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.378864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b3b0-0d30-4931-b4a5-69831a13db5e admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.379166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b3b0-0d30-4931-b4a5-69831a13db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.379424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284b3b0-0d30-4931-b4a5-69831a13db5e admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.380132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b3b0-0d30-4931-b4a5-69831a13db5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.382144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284b3b0-0d30-4931-b4a5-69831a13db5e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.390664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974ee47-2640-4547-83fa-4b14fdce5c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5ecc3caead4bafa0eb482f7bfcbb8d, user_id=db7829885dc947c0ac37a7a0c653c67a, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.393534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974ee47-2640-4547-83fa-4b14fdce5c76 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.410519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 923/1835] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:11.412154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b3b0-0d30-4931-b4a5-69831a13db5e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.419082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 913/1836] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:11 2022] PUT /identity/v3/projects/ef5ecc3caead4bafa0eb482f7bfcbb8d/users/db7829885dc947c0ac37a7a0c653c67a/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:11.420020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974ee47-2640-4547-83fa-4b14fdce5c76 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.422682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284b3b0-0d30-4931-b4a5-69831a13db5e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.486714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80b42d-9b73-4ae1-988b-083a6aa839e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.487385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b42d-9b73-4ae1-988b-083a6aa839e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.487802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b42d-9b73-4ae1-988b-083a6aa839e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.488103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80b42d-9b73-4ae1-988b-083a6aa839e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.488776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80b42d-9b73-4ae1-988b-083a6aa839e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.490771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80b42d-9b73-4ae1-988b-083a6aa839e1 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.507753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974ee47-2640-4547-83fa-4b14fdce5c76 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.520947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e18160-e6fd-4f1f-847f-b039d27eedac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.521629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18160-e6fd-4f1f-847f-b039d27eedac admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.521913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18160-e6fd-4f1f-847f-b039d27eedac admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.522190 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e18160-e6fd-4f1f-847f-b039d27eedac admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.522969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e18160-e6fd-4f1f-847f-b039d27eedac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.524563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e18160-e6fd-4f1f-847f-b039d27eedac admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.528348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 924/1837] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/projects => generated 361 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:11.529730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7a7f1-f54f-4c6c-b5fb-536abf5a7c2d None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.530154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7a7f1-f54f-4c6c-b5fb-536abf5a7c2d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.530460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7a7f1-f54f-4c6c-b5fb-536abf5a7c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.535967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 914/1838] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:11.536764 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e18160-e6fd-4f1f-847f-b039d27eedac admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.549158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e18160-e6fd-4f1f-847f-b039d27eedac admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.566098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-cef7a7f1-f54f-4c6c-b5fb-536abf5a7c2d None None] MFA Rules not processed for user `db7829885dc947c0ac37a7a0c653c67a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:11.567642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-cef7a7f1-f54f-4c6c-b5fb-536abf5a7c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:11.612823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4897c06-340f-444f-90a8-c5cb8789567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.613636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4897c06-340f-444f-90a8-c5cb8789567c admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.614170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4897c06-340f-444f-90a8-c5cb8789567c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.614522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4897c06-340f-444f-90a8-c5cb8789567c admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.615260 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4897c06-340f-444f-90a8-c5cb8789567c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.617241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4897c06-340f-444f-90a8-c5cb8789567c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.639709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 925/1839] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:11.642777 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 915/1840] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:11.642921 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7a7f1-f54f-4c6c-b5fb-536abf5a7c2d None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.643001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4897c06-340f-444f-90a8-c5cb8789567c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.643506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a4897c06-340f-444f-90a8-c5cb8789567c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:11.652907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7a7f1-f54f-4c6c-b5fb-536abf5a7c2d None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.662358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795cce-6aff-4020-9fc3-96c05d861e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.663232 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795cce-6aff-4020-9fc3-96c05d861e55 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.663394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795cce-6aff-4020-9fc3-96c05d861e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.663681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a795cce-6aff-4020-9fc3-96c05d861e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.664415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a795cce-6aff-4020-9fc3-96c05d861e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.666041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a795cce-6aff-4020-9fc3-96c05d861e55 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.680919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 926/1841] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:11.680919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795cce-6aff-4020-9fc3-96c05d861e55 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.690424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a795cce-6aff-4020-9fc3-96c05d861e55 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.695021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b34466-255f-4681-aa47-da947aecc833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.695660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b34466-255f-4681-aa47-da947aecc833 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.695946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b34466-255f-4681-aa47-da947aecc833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.696224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b34466-255f-4681-aa47-da947aecc833 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.696902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b34466-255f-4681-aa47-da947aecc833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.698870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b34466-255f-4681-aa47-da947aecc833 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.714186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4897c06-340f-444f-90a8-c5cb8789567c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.718144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe24f8e-74c3-400b-b178-286308ca2b01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.718966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe24f8e-74c3-400b-b178-286308ca2b01 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.719365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe24f8e-74c3-400b-b178-286308ca2b01 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.719816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe24f8e-74c3-400b-b178-286308ca2b01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.721694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bfe24f8e-74c3-400b-b178-286308ca2b01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:11.728035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 927/1842] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:11.728035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b34466-255f-4681-aa47-da947aecc833 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.780993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe24f8e-74c3-400b-b178-286308ca2b01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.782491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe24f8e-74c3-400b-b178-286308ca2b01 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.785601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b34466-255f-4681-aa47-da947aecc833 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.791369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458193d-17ae-42f7-87c4-20e0fa9e7f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.791982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458193d-17ae-42f7-87c4-20e0fa9e7f01 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.792264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458193d-17ae-42f7-87c4-20e0fa9e7f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.792538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458193d-17ae-42f7-87c4-20e0fa9e7f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.792788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 916/1843] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:11.793341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458193d-17ae-42f7-87c4-20e0fa9e7f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.793559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe24f8e-74c3-400b-b178-286308ca2b01 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.795034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458193d-17ae-42f7-87c4-20e0fa9e7f01 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.804161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe24f8e-74c3-400b-b178-286308ca2b01 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.805490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 928/1844] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:11.806284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458193d-17ae-42f7-87c4-20e0fa9e7f01 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.811573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f9c71-a611-4b1b-b58b-6516e27825f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.812615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f9c71-a611-4b1b-b58b-6516e27825f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.812968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f9c71-a611-4b1b-b58b-6516e27825f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.813325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f9c71-a611-4b1b-b58b-6516e27825f2 admin admin] PATH_INFO: `/v3/projects/7fb1f7f332ab4bf59125a8e9ae442423/users/15a39b6f08124daeba1f442aa321f7d1/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.818051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458193d-17ae-42f7-87c4-20e0fa9e7f01 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.823832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69327f05-3ea8-441b-94b5-3c275311c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.824488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327f05-3ea8-441b-94b5-3c275311c36f admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.824769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327f05-3ea8-441b-94b5-3c275311c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.825134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69327f05-3ea8-441b-94b5-3c275311c36f admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.825717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69327f05-3ea8-441b-94b5-3c275311c36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.827827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69327f05-3ea8-441b-94b5-3c275311c36f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.830299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f9c71-a611-4b1b-b58b-6516e27825f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb1f7f332ab4bf59125a8e9ae442423, user_id=15a39b6f08124daeba1f442aa321f7d1, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.833501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f9c71-a611-4b1b-b58b-6516e27825f2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.848084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 917/1845] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:11 2022] PUT /identity/v3/projects/7fb1f7f332ab4bf59125a8e9ae442423/users/15a39b6f08124daeba1f442aa321f7d1/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:11.850136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 929/1846] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:11.854168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69327f05-3ea8-441b-94b5-3c275311c36f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.858425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f9c71-a611-4b1b-b58b-6516e27825f2 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:11.864282 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69327f05-3ea8-441b-94b5-3c275311c36f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.927350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717201-a91b-48d7-a7ec-810104e56c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.928168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717201-a91b-48d7-a7ec-810104e56c30 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.928628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717201-a91b-48d7-a7ec-810104e56c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.928982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717201-a91b-48d7-a7ec-810104e56c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.929931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717201-a91b-48d7-a7ec-810104e56c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:11.932298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717201-a91b-48d7-a7ec-810104e56c30 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:11.948984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 930/1847] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:11.948984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a137a-2e0c-4619-a3b8-6e7a7cc88b90 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.948984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a137a-2e0c-4619-a3b8-6e7a7cc88b90 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.949342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a137a-2e0c-4619-a3b8-6e7a7cc88b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.951006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f9c71-a611-4b1b-b58b-6516e27825f2 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:11.956949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ce819-95fb-4b12-9cf1-cc9c1ec274f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:11.958404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce819-95fb-4b12-9cf1-cc9c1ec274f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:11.959844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce819-95fb-4b12-9cf1-cc9c1ec274f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:11.960522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ce819-95fb-4b12-9cf1-cc9c1ec274f3 admin admin] PATH_INFO: `/v3/projects/1bcb7b7ba1f34f8e833a6d84877af488/users/c5e4834526384450a45534660106ba24/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:11.995931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ce819-95fb-4b12-9cf1-cc9c1ec274f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcb7b7ba1f34f8e833a6d84877af488, user_id=c5e4834526384450a45534660106ba24, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.005088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8ce819-95fb-4b12-9cf1-cc9c1ec274f3 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.015724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1b1a137a-2e0c-4619-a3b8-6e7a7cc88b90 None None] MFA Rules not processed for user `15a39b6f08124daeba1f442aa321f7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:12.017214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1b1a137a-2e0c-4619-a3b8-6e7a7cc88b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:12.035168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 918/1848] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:11 2022] PUT /identity/v3/projects/1bcb7b7ba1f34f8e833a6d84877af488/users/c5e4834526384450a45534660106ba24/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:12.038068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ce819-95fb-4b12-9cf1-cc9c1ec274f3 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.141612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ce819-95fb-4b12-9cf1-cc9c1ec274f3 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.150214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295713a-47df-4769-ae95-1f2dec4eb910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.151305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295713a-47df-4769-ae95-1f2dec4eb910 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.151849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295713a-47df-4769-ae95-1f2dec4eb910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.152127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295713a-47df-4769-ae95-1f2dec4eb910 admin admin] PATH_INFO: `/v3/projects/ce5916c45f8a4361adcaa0183dec0963/users/4853bb06eb434bb99c00affff98bf8fc/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.168511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 931/1849] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:12.169603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a137a-2e0c-4619-a3b8-6e7a7cc88b90 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.184822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a137a-2e0c-4619-a3b8-6e7a7cc88b90 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.190321 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caa867-4288-4b05-b65c-544ff1aaa583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.191011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa867-4288-4b05-b65c-544ff1aaa583 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.191296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa867-4288-4b05-b65c-544ff1aaa583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.191573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa867-4288-4b05-b65c-544ff1aaa583 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.191957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295713a-47df-4769-ae95-1f2dec4eb910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5916c45f8a4361adcaa0183dec0963, user_id=4853bb06eb434bb99c00affff98bf8fc, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.192500 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caa867-4288-4b05-b65c-544ff1aaa583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.194348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caa867-4288-4b05-b65c-544ff1aaa583 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.195282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295713a-47df-4769-ae95-1f2dec4eb910 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.211346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 932/1850] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:12.211346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caa867-4288-4b05-b65c-544ff1aaa583 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.216675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 919/1851] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:12 2022] PUT /identity/v3/projects/ce5916c45f8a4361adcaa0183dec0963/users/4853bb06eb434bb99c00affff98bf8fc/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:12.217690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295713a-47df-4769-ae95-1f2dec4eb910 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.225894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caa867-4288-4b05-b65c-544ff1aaa583 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.289905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae00528-0451-41fe-ab40-2ea45ef6c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.290635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae00528-0451-41fe-ab40-2ea45ef6c13f admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.290922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae00528-0451-41fe-ab40-2ea45ef6c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.291201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae00528-0451-41fe-ab40-2ea45ef6c13f admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.291897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae00528-0451-41fe-ab40-2ea45ef6c13f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.293802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae00528-0451-41fe-ab40-2ea45ef6c13f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.319960 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295713a-47df-4769-ae95-1f2dec4eb910 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.331481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c054d0-ab2d-43c4-872d-b2a492b8a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.332347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c054d0-ab2d-43c4-872d-b2a492b8a7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.332678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c054d0-ab2d-43c4-872d-b2a492b8a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.332969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c054d0-ab2d-43c4-872d-b2a492b8a7aa admin admin] PATH_INFO: `/v3/projects/1bcb7b7ba1f34f8e833a6d84877af488/users/c5e4834526384450a45534660106ba24/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.344780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c054d0-ab2d-43c4-872d-b2a492b8a7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcb7b7ba1f34f8e833a6d84877af488, user_id=c5e4834526384450a45534660106ba24, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.348750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c054d0-ab2d-43c4-872d-b2a492b8a7aa admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.357959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 933/1852] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:12 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:12.358657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae00528-0451-41fe-ab40-2ea45ef6c13f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.390160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 920/1853] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:12 2022] PUT /identity/v3/projects/1bcb7b7ba1f34f8e833a6d84877af488/users/c5e4834526384450a45534660106ba24/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:12.393814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c054d0-ab2d-43c4-872d-b2a492b8a7aa admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.470727 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c054d0-ab2d-43c4-872d-b2a492b8a7aa admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.479586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90518745-cf99-456c-9c9e-3f52153203fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.480299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518745-cf99-456c-9c9e-3f52153203fb admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.480580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518745-cf99-456c-9c9e-3f52153203fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.480851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90518745-cf99-456c-9c9e-3f52153203fb admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.483318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90518745-cf99-456c-9c9e-3f52153203fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.488537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90518745-cf99-456c-9c9e-3f52153203fb admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.497173 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae00528-0451-41fe-ab40-2ea45ef6c13f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.503503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bea4d-1dd4-4476-b38b-e1a228cc277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.504421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bea4d-1dd4-4476-b38b-e1a228cc277e admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.504710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bea4d-1dd4-4476-b38b-e1a228cc277e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.505035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bea4d-1dd4-4476-b38b-e1a228cc277e admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.505890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bea4d-1dd4-4476-b38b-e1a228cc277e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.507609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bea4d-1dd4-4476-b38b-e1a228cc277e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.518785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 921/1854] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:12 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:12.529055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 934/1855] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:12.529055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bea4d-1dd4-4476-b38b-e1a228cc277e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.531233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d634b-88a6-4650-aa94-4ce2645ee63d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.531880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d634b-88a6-4650-aa94-4ce2645ee63d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.532334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d634b-88a6-4650-aa94-4ce2645ee63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.542213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bea4d-1dd4-4476-b38b-e1a228cc277e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.554906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e53349-860c-44b3-a36e-3c3125f18b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.555647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e53349-860c-44b3-a36e-3c3125f18b17 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.555931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e53349-860c-44b3-a36e-3c3125f18b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.556201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e53349-860c-44b3-a36e-3c3125f18b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.556975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e53349-860c-44b3-a36e-3c3125f18b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.558600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e53349-860c-44b3-a36e-3c3125f18b17 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.573633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 935/1856] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:12.573633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e53349-860c-44b3-a36e-3c3125f18b17 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.583368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-4a7d634b-88a6-4650-aa94-4ce2645ee63d None None] MFA Rules not processed for user `c5e4834526384450a45534660106ba24`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:12.584895 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4a7d634b-88a6-4650-aa94-4ce2645ee63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:12.586700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e53349-860c-44b3-a36e-3c3125f18b17 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.594453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff6a0e-4967-4231-a3d7-81e3ca0e8149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.595466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff6a0e-4967-4231-a3d7-81e3ca0e8149 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.596339 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff6a0e-4967-4231-a3d7-81e3ca0e8149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.597104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff6a0e-4967-4231-a3d7-81e3ca0e8149 admin admin] PATH_INFO: `/v3/projects/ce5916c45f8a4361adcaa0183dec0963/users/4853bb06eb434bb99c00affff98bf8fc/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.599574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff6a0e-4967-4231-a3d7-81e3ca0e8149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5916c45f8a4361adcaa0183dec0963, user_id=4853bb06eb434bb99c00affff98bf8fc, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.602390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff6a0e-4967-4231-a3d7-81e3ca0e8149 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.625806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 936/1857] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:12 2022] PUT /identity/v3/projects/ce5916c45f8a4361adcaa0183dec0963/users/4853bb06eb434bb99c00affff98bf8fc/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:12.627518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff6a0e-4967-4231-a3d7-81e3ca0e8149 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.706142 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 922/1858] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:12 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:12.707686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b7bf8-5d11-4bda-91b2-996500896d60 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.708471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b7bf8-5d11-4bda-91b2-996500896d60 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.708884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b7bf8-5d11-4bda-91b2-996500896d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.712149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff6a0e-4967-4231-a3d7-81e3ca0e8149 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.720207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224e5e0-44b3-4fe7-8513-f8edca7bf545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.721853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224e5e0-44b3-4fe7-8513-f8edca7bf545 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.722378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224e5e0-44b3-4fe7-8513-f8edca7bf545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.724485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224e5e0-44b3-4fe7-8513-f8edca7bf545 admin admin] PATH_INFO: `/v3/projects/15ebf6d69be1485d9331082882a795b7/users/bc3dc6b8b6da4eacb48be962f973bea7/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:12.754524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224e5e0-44b3-4fe7-8513-f8edca7bf545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ebf6d69be1485d9331082882a795b7, user_id=bc3dc6b8b6da4eacb48be962f973bea7, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:12.758899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6b8b7bf8-5d11-4bda-91b2-996500896d60 None None] MFA Rules not processed for user `4853bb06eb434bb99c00affff98bf8fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:12.760774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224e5e0-44b3-4fe7-8513-f8edca7bf545 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:12.761815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6b8b7bf8-5d11-4bda-91b2-996500896d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:12.798835 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 937/1859] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:12 2022] PUT /identity/v3/projects/15ebf6d69be1485d9331082882a795b7/users/bc3dc6b8b6da4eacb48be962f973bea7/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:12.802499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224e5e0-44b3-4fe7-8513-f8edca7bf545 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.874244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 923/1860] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:12.874244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b7bf8-5d11-4bda-91b2-996500896d60 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:12.894545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b7bf8-5d11-4bda-91b2-996500896d60 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.897622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224e5e0-44b3-4fe7-8513-f8edca7bf545 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:12.908028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6376d7b-76d1-494b-a473-0fc7a8af4998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:12.908911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6376d7b-76d1-494b-a473-0fc7a8af4998 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:12.909193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6376d7b-76d1-494b-a473-0fc7a8af4998 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:12.909462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6376d7b-76d1-494b-a473-0fc7a8af4998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.007345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6376d7b-76d1-494b-a473-0fc7a8af4998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:13.009403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae7f44-58ae-415d-b2bf-82c656ad62f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:13.009946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6376d7b-76d1-494b-a473-0fc7a8af4998 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:13.010135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7f44-58ae-415d-b2bf-82c656ad62f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:13.010462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7f44-58ae-415d-b2bf-82c656ad62f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:13.010745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae7f44-58ae-415d-b2bf-82c656ad62f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.011590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae7f44-58ae-415d-b2bf-82c656ad62f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:13.013678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae7f44-58ae-415d-b2bf-82c656ad62f3 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:13.027793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 924/1861] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:13.028667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae7f44-58ae-415d-b2bf-82c656ad62f3 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:13.034126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 938/1862] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:12 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:13.035582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6376d7b-76d1-494b-a473-0fc7a8af4998 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:13.047107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6376d7b-76d1-494b-a473-0fc7a8af4998 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:13.053391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51090ccc-ffff-4f50-a58f-771c6370ff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:13.054343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51090ccc-ffff-4f50-a58f-771c6370ff4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:13.056561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51090ccc-ffff-4f50-a58f-771c6370ff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:13.056967 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51090ccc-ffff-4f50-a58f-771c6370ff4f admin admin] PATH_INFO: `/v3/projects/15ebf6d69be1485d9331082882a795b7/users/bc3dc6b8b6da4eacb48be962f973bea7/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.065189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51090ccc-ffff-4f50-a58f-771c6370ff4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=15ebf6d69be1485d9331082882a795b7, user_id=bc3dc6b8b6da4eacb48be962f973bea7, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:13.070811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51090ccc-ffff-4f50-a58f-771c6370ff4f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:13.071756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae7f44-58ae-415d-b2bf-82c656ad62f3 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:13.098366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 939/1863] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:13 2022] PUT /identity/v3/projects/15ebf6d69be1485d9331082882a795b7/users/bc3dc6b8b6da4eacb48be962f973bea7/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:13.100097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4c7c5-db46-4947-8b72-f8f5aafafcf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:13.102890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4c7c5-db46-4947-8b72-f8f5aafafcf6 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:13.105575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4c7c5-db46-4947-8b72-f8f5aafafcf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:13.106508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4c7c5-db46-4947-8b72-f8f5aafafcf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.112523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e3c08-8d46-42d1-8025-32f4f83f8828 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:13.112523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e3c08-8d46-42d1-8025-32f4f83f8828 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:13.115502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e3c08-8d46-42d1-8025-32f4f83f8828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.179504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-654e3c08-8d46-42d1-8025-32f4f83f8828 None None] MFA Rules not processed for user `bc3dc6b8b6da4eacb48be962f973bea7`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:13.188167 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-654e3c08-8d46-42d1-8025-32f4f83f8828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:13.310156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4c7c5-db46-4947-8b72-f8f5aafafcf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:13.311771 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4c7c5-db46-4947-8b72-f8f5aafafcf6 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:13.324260 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 925/1864] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:13.326882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 940/1865] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:13.338475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4c7c5-db46-4947-8b72-f8f5aafafcf6 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:13.361658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4c7c5-db46-4947-8b72-f8f5aafafcf6 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:13.421910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e3c08-8d46-42d1-8025-32f4f83f8828 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:13.440592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8dffc-35d2-4f7d-a6b1-4a6cea755986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:13.441566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8dffc-35d2-4f7d-a6b1-4a6cea755986 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:13.442105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8dffc-35d2-4f7d-a6b1-4a6cea755986 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:13.443493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8dffc-35d2-4f7d-a6b1-4a6cea755986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.525173 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e3c08-8d46-42d1-8025-32f4f83f8828 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:13.527440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8dffc-35d2-4f7d-a6b1-4a6cea755986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:13.529685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8dffc-35d2-4f7d-a6b1-4a6cea755986 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:13.532864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe30faf-3ff7-4611-b3bd-018187526eba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:13.535464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe30faf-3ff7-4611-b3bd-018187526eba service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:13.535856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe30faf-3ff7-4611-b3bd-018187526eba service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:13.541612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe30faf-3ff7-4611-b3bd-018187526eba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.543537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 926/1866] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:13.583349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964eea-30fd-47d9-b603-c126215adc05 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:13.584025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964eea-30fd-47d9-b603-c126215adc05 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:13.584545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8964eea-30fd-47d9-b603-c126215adc05 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.586619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 927/1867] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:26:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:26:13.601633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e68c5-9f45-4750-baee-23f2ad240560 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:13.602862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e68c5-9f45-4750-baee-23f2ad240560 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:13.603352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e68c5-9f45-4750-baee-23f2ad240560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.623427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe30faf-3ff7-4611-b3bd-018187526eba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:13.625574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe30faf-3ff7-4611-b3bd-018187526eba service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:13.642188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-537e68c5-9f45-4750-baee-23f2ad240560 None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:13.645797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 941/1868] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:13.646470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-537e68c5-9f45-4750-baee-23f2ad240560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:13.773351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 928/1869] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:26:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:13.781362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe30faf-3ff7-4611-b3bd-018187526eba service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:13.784630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-cbe30faf-3ff7-4611-b3bd-018187526eba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:13.810059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe30faf-3ff7-4611-b3bd-018187526eba service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:13.834555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400dd96-5371-4ad8-a643-5fbaa5e4a8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:13.834555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400dd96-5371-4ad8-a643-5fbaa5e4a8a6 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:13.837030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400dd96-5371-4ad8-a643-5fbaa5e4a8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:13.837291 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400dd96-5371-4ad8-a643-5fbaa5e4a8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:13.861135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400dd96-5371-4ad8-a643-5fbaa5e4a8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:13.863059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400dd96-5371-4ad8-a643-5fbaa5e4a8a6 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:13.881632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 942/1870] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:14.277847 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e68c5-9f45-4750-baee-23f2ad240560 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:14.291839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e68c5-9f45-4750-baee-23f2ad240560 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:14.295621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402071a4-798f-4c1c-9030-4fba5cf9c2a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:14.296343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402071a4-798f-4c1c-9030-4fba5cf9c2a8 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:14.296694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402071a4-798f-4c1c-9030-4fba5cf9c2a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:14.297037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402071a4-798f-4c1c-9030-4fba5cf9c2a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:14.370190 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402071a4-798f-4c1c-9030-4fba5cf9c2a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:14.371676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402071a4-798f-4c1c-9030-4fba5cf9c2a8 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:14.401033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 929/1871] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:15.502576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400dd96-5371-4ad8-a643-5fbaa5e4a8a6 service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:15.514042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400dd96-5371-4ad8-a643-5fbaa5e4a8a6 service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:15.518063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826df83e-863d-4000-b8b0-2bb47e214dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:15.519051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826df83e-863d-4000-b8b0-2bb47e214dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:15.519337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826df83e-863d-4000-b8b0-2bb47e214dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:15.519610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826df83e-863d-4000-b8b0-2bb47e214dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:15.606617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826df83e-863d-4000-b8b0-2bb47e214dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:15.608162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826df83e-863d-4000-b8b0-2bb47e214dd7 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:15.619463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 943/1872] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:16.750749 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078515b4-b153-49fc-aa8c-eb1f3aec08f2 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:16.752066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078515b4-b153-49fc-aa8c-eb1f3aec08f2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:16.753160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078515b4-b153-49fc-aa8c-eb1f3aec08f2 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:16.756835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 930/1873] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:26:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:26:16.775540 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826df83e-863d-4000-b8b0-2bb47e214dd7 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:16.787312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826df83e-863d-4000-b8b0-2bb47e214dd7 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:16.793744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3efc4-adf7-430e-9065-dc39c943da96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:16.797949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3efc4-adf7-430e-9065-dc39c943da96 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:16.798417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3efc4-adf7-430e-9065-dc39c943da96 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:16.798800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3efc4-adf7-430e-9065-dc39c943da96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:16.812925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3efc4-adf7-430e-9065-dc39c943da96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:16.814793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3efc4-adf7-430e-9065-dc39c943da96 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:16.828313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 944/1874] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:16.875471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eb20e-4099-4323-bce9-aa9789ea52b7 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:16.875941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eb20e-4099-4323-bce9-aa9789ea52b7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:16.876340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2eb20e-4099-4323-bce9-aa9789ea52b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:16.905355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fd2eb20e-4099-4323-bce9-aa9789ea52b7 None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:16.906800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fd2eb20e-4099-4323-bce9-aa9789ea52b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:16.914643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3efc4-adf7-430e-9065-dc39c943da96 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:16.919716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 931/1875] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:26:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:16.927979 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3efc4-adf7-430e-9065-dc39c943da96 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:16.931808 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434632ab-e038-40d5-bd2c-2788bbc0ac5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:16.932454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434632ab-e038-40d5-bd2c-2788bbc0ac5a service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:16.932736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434632ab-e038-40d5-bd2c-2788bbc0ac5a service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:16.933007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434632ab-e038-40d5-bd2c-2788bbc0ac5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:16.934896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-434632ab-e038-40d5-bd2c-2788bbc0ac5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:16.940218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2eb20e-4099-4323-bce9-aa9789ea52b7 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:16.941934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fd2eb20e-4099-4323-bce9-aa9789ea52b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:16.966804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2eb20e-4099-4323-bce9-aa9789ea52b7 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:16.982862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91364209-3e5c-496e-8f5c-291bbd48cb53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:16.986674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91364209-3e5c-496e-8f5c-291bbd48cb53 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:16.987121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91364209-3e5c-496e-8f5c-291bbd48cb53 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:16.988166 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91364209-3e5c-496e-8f5c-291bbd48cb53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:17.014041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91364209-3e5c-496e-8f5c-291bbd48cb53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:17.017492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91364209-3e5c-496e-8f5c-291bbd48cb53 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:17.033465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 932/1876] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:17.045230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434632ab-e038-40d5-bd2c-2788bbc0ac5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:17.046964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434632ab-e038-40d5-bd2c-2788bbc0ac5a service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:17.059854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 945/1877] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:23.233587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91364209-3e5c-496e-8f5c-291bbd48cb53 service nova] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:23.334521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91364209-3e5c-496e-8f5c-291bbd48cb53 service nova] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:23.347753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:23.349461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:23.349923 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:23.350385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] PATH_INFO: `/v3/users/db7829885dc947c0ac37a7a0c653c67a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:23.351885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7829885dc947c0ac37a7a0c653c67a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:23.361718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:23.441757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7829885dc947c0ac37a7a0c653c67a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:23.459438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7829885dc947c0ac37a7a0c653c67a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:23.475950 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7829885dc947c0ac37a7a0c653c67a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:23.477126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7829885dc947c0ac37a7a0c653c67a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:23.477912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7829885dc947c0ac37a7a0c653c67a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:23.500655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 933/1878] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:23 2022] DELETE /identity/v3/users/db7829885dc947c0ac37a7a0c653c67a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:23.504905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7f1f7-9853-4575-a041-044b6bdd22be None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:23.505408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7f1f7-9853-4575-a041-044b6bdd22be None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:23.505522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7f1f7-9853-4575-a041-044b6bdd22be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:23.527401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-89f7f1f7-9853-4575-a041-044b6bdd22be None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:23.528624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-89f7f1f7-9853-4575-a041-044b6bdd22be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:23.603343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 946/1879] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:23.613302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:23.615350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:23.681100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe173e-4a74-4961-bbf9-9dead17ab675 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:23.686495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50ea13-ac56-4017-89bf-3da797ae3e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:23.687394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50ea13-ac56-4017-89bf-3da797ae3e06 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:23.687924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50ea13-ac56-4017-89bf-3da797ae3e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:23.688305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50ea13-ac56-4017-89bf-3da797ae3e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:23.705786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50ea13-ac56-4017-89bf-3da797ae3e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:23.707314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50ea13-ac56-4017-89bf-3da797ae3e06 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:23.717250 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 934/1880] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:24.522521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7f1f7-9853-4575-a041-044b6bdd22be None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:24.524086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-89f7f1f7-9853-4575-a041-044b6bdd22be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:24.543356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7f1f7-9853-4575-a041-044b6bdd22be None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:24.549598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:24.550794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:24.551132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:24.552246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] PATH_INFO: `/v3/projects/ef5ecc3caead4bafa0eb482f7bfcbb8d` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:24.553558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5ecc3caead4bafa0eb482f7bfcbb8d)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:24.557413 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:24.693295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5ecc3caead4bafa0eb482f7bfcbb8d', 'request_id': 'req-f5761257-ec19-4fcc-ac06-7649f4819580'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.701281 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50ea13-ac56-4017-89bf-3da797ae3e06 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:24.702909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ba50ea13-ac56-4017-89bf-3da797ae3e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:24.715890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50ea13-ac56-4017-89bf-3da797ae3e06 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:24.734720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5ecc3caead4bafa0eb482f7bfcbb8d', 'request_id': 'req-f5761257-ec19-4fcc-ac06-7649f4819580'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.745523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5ecc3caead4bafa0eb482f7bfcbb8d', 'request_id': 'req-f5761257-ec19-4fcc-ac06-7649f4819580'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.774710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] The token cache is being invalidate because project ef5ecc3caead4bafa0eb482f7bfcbb8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:24.775626 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.777294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.780373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 947/1881] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:24 2022] DELETE /identity/v3/projects/ef5ecc3caead4bafa0eb482f7bfcbb8d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:24.784667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:24.788696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:24.793530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:24.795412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:24.796772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:24.800168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] PATH_INFO: `/v3/users/f5de569162f6494d90fc6e61d5ca3a9a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:24.808489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5761257-ec19-4fcc-ac06-7649f4819580 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:24.815867 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:24.817768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:24.818499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:24.818984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] PATH_INFO: `/v3/users/4853bb06eb434bb99c00affff98bf8fc` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:24.822052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5de569162f6494d90fc6e61d5ca3a9a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:24.822481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4853bb06eb434bb99c00affff98bf8fc)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:24.824092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:24.826400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:24.919365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4853bb06eb434bb99c00affff98bf8fc'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.927454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5de569162f6494d90fc6e61d5ca3a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.928563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4853bb06eb434bb99c00affff98bf8fc'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.936229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5de569162f6494d90fc6e61d5ca3a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.939878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4853bb06eb434bb99c00affff98bf8fc'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.941117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4853bb06eb434bb99c00affff98bf8fc'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.942086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e9e72fb1-ad09-40e8-93cd-6b077f2e251b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4853bb06eb434bb99c00affff98bf8fc'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.958461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5de569162f6494d90fc6e61d5ca3a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.958461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5de569162f6494d90fc6e61d5ca3a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.958461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5de569162f6494d90fc6e61d5ca3a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:24.972332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 948/1882] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:24 2022] DELETE /identity/v3/users/4853bb06eb434bb99c00affff98bf8fc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:24.986428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 935/1883] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:24 2022] DELETE /identity/v3/users/f5de569162f6494d90fc6e61d5ca3a9a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:24.990727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44df26-a4e5-4147-a9eb-55ae1b69b870 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:24.991091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44df26-a4e5-4147-a9eb-55ae1b69b870 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:24.991438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44df26-a4e5-4147-a9eb-55ae1b69b870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.011516 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-6e44df26-a4e5-4147-a9eb-55ae1b69b870 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:25.012898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6e44df26-a4e5-4147-a9eb-55ae1b69b870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:25.089419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 949/1884] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:25.126191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:25.127690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:25.214182 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79fdc-e087-43bb-bc7c-ab8be59a158d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:25.218604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683b38e-58f0-477a-9214-03aedca597a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:25.219780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b38e-58f0-477a-9214-03aedca597a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:25.220516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b38e-58f0-477a-9214-03aedca597a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:25.220516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b38e-58f0-477a-9214-03aedca597a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.234042 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683b38e-58f0-477a-9214-03aedca597a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:25.235713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683b38e-58f0-477a-9214-03aedca597a4 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:25.252482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 936/1885] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:25.307841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44df26-a4e5-4147-a9eb-55ae1b69b870 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:25.309695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6e44df26-a4e5-4147-a9eb-55ae1b69b870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:25.326156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44df26-a4e5-4147-a9eb-55ae1b69b870 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:25.331871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:25.333349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:25.333637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:25.333919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] PATH_INFO: `/v3/projects/ce5916c45f8a4361adcaa0183dec0963` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.335178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5916c45f8a4361adcaa0183dec0963)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:25.337225 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:25.405575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5916c45f8a4361adcaa0183dec0963', 'request_id': 'req-ec05b3d3-305f-4607-9b92-a32d8abe211d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.428438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5916c45f8a4361adcaa0183dec0963', 'request_id': 'req-ec05b3d3-305f-4607-9b92-a32d8abe211d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.443422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5916c45f8a4361adcaa0183dec0963', 'request_id': 'req-ec05b3d3-305f-4607-9b92-a32d8abe211d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.462855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] The token cache is being invalidate because project ce5916c45f8a4361adcaa0183dec0963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:25.463366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.464423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec05b3d3-305f-4607-9b92-a32d8abe211d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.467251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 950/1886] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:25 2022] DELETE /identity/v3/projects/ce5916c45f8a4361adcaa0183dec0963 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:25.472435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc2f67-7d52-447e-804e-1f23c274f488 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:25.472934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc2f67-7d52-447e-804e-1f23c274f488 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:25.473437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc2f67-7d52-447e-804e-1f23c274f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.493679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d9fc2f67-7d52-447e-804e-1f23c274f488 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:25.494954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d9fc2f67-7d52-447e-804e-1f23c274f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:25.559096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 937/1887] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:25.566731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a00c63-67ef-4840-b5ae-f83007524561 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:25.567778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a00c63-67ef-4840-b5ae-f83007524561 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:25.567884 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a00c63-67ef-4840-b5ae-f83007524561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.585777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a7a00c63-67ef-4840-b5ae-f83007524561 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:25.587020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a7a00c63-67ef-4840-b5ae-f83007524561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:25.595814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 951/1888] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:25.600713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc2f67-7d52-447e-804e-1f23c274f488 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:25.610748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc2f67-7d52-447e-804e-1f23c274f488 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:25.615436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a413aa-bfb0-4954-b8b7-4e375ee4f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:25.616201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a413aa-bfb0-4954-b8b7-4e375ee4f688 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:25.616548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a413aa-bfb0-4954-b8b7-4e375ee4f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:25.616888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a413aa-bfb0-4954-b8b7-4e375ee4f688 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.617685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a413aa-bfb0-4954-b8b7-4e375ee4f688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:25.618085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a413aa-bfb0-4954-b8b7-4e375ee4f688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:25.619794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a413aa-bfb0-4954-b8b7-4e375ee4f688 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:25.631774 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 938/1889] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:25.636061 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a00c63-67ef-4840-b5ae-f83007524561 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:25.646586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a00c63-67ef-4840-b5ae-f83007524561 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:25.651918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4f811-8a55-4247-8685-9df83563d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:25.652585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4f811-8a55-4247-8685-9df83563d0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:25.652870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4f811-8a55-4247-8685-9df83563d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:25.653141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a4f811-8a55-4247-8685-9df83563d0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.653828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4f811-8a55-4247-8685-9df83563d0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:25.655764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a4f811-8a55-4247-8685-9df83563d0e6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:25.707406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 952/1890] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:25 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:25.711940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a413aa-bfb0-4954-b8b7-4e375ee4f688 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:25.723731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a413aa-bfb0-4954-b8b7-4e375ee4f688 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:25.743316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4f811-8a55-4247-8685-9df83563d0e6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:25.745695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-01a4f811-8a55-4247-8685-9df83563d0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:25.805289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc460-0ab8-46ea-af2d-49e6ba323b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:25.805998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc460-0ab8-46ea-af2d-49e6ba323b33 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:25.806323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc460-0ab8-46ea-af2d-49e6ba323b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:25.806604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfc460-0ab8-46ea-af2d-49e6ba323b33 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.807303 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfc460-0ab8-46ea-af2d-49e6ba323b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:25.809786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfc460-0ab8-46ea-af2d-49e6ba323b33 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:25.828262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a4f811-8a55-4247-8685-9df83563d0e6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:25.834087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:25.835245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:25.835679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:25.836171 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] PATH_INFO: `/v3/projects/7064d0546e694f3da0860b61cefe8185` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.837541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7064d0546e694f3da0860b61cefe8185)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:25.838528 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 939/1891] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:25 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:25.840475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:25.843043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc460-0ab8-46ea-af2d-49e6ba323b33 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:25.853159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfc460-0ab8-46ea-af2d-49e6ba323b33 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:25.863479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de138faf-f203-4555-9a85-c871c5c29823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:25.865066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de138faf-f203-4555-9a85-c871c5c29823 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:25.865353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de138faf-f203-4555-9a85-c871c5c29823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:25.865673 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de138faf-f203-4555-9a85-c871c5c29823 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:25.866450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de138faf-f203-4555-9a85-c871c5c29823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:25.868800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de138faf-f203-4555-9a85-c871c5c29823 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:25.886596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 940/1892] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:25.891288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de138faf-f203-4555-9a85-c871c5c29823 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:25.898778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7064d0546e694f3da0860b61cefe8185', 'request_id': 'req-b22ab20f-2295-45b7-b108-59b1738b9a39'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.908785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de138faf-f203-4555-9a85-c871c5c29823 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:25.927113 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7064d0546e694f3da0860b61cefe8185', 'request_id': 'req-b22ab20f-2295-45b7-b108-59b1738b9a39'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.935782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7064d0546e694f3da0860b61cefe8185', 'request_id': 'req-b22ab20f-2295-45b7-b108-59b1738b9a39'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.969665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] The token cache is being invalidate because project 7064d0546e694f3da0860b61cefe8185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:25.971555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.976596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:25.979868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 953/1893] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:25 2022] DELETE /identity/v3/projects/7064d0546e694f3da0860b61cefe8185 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:25.984174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:25.987961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.011421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7caf41-2129-4e87-b412-df5ea92a5fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.012442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7caf41-2129-4e87-b412-df5ea92a5fed admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.012914 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7caf41-2129-4e87-b412-df5ea92a5fed admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.013397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7caf41-2129-4e87-b412-df5ea92a5fed admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.014975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7caf41-2129-4e87-b412-df5ea92a5fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.017064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7caf41-2129-4e87-b412-df5ea92a5fed admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.031046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 941/1894] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:26.035916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7caf41-2129-4e87-b412-df5ea92a5fed admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.039421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0b7caf41-2129-4e87-b412-df5ea92a5fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.070498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7caf41-2129-4e87-b412-df5ea92a5fed admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.099124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10493-8a44-449a-aec6-1e259de5c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.100041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10493-8a44-449a-aec6-1e259de5c768 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.100470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10493-8a44-449a-aec6-1e259de5c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.100874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10493-8a44-449a-aec6-1e259de5c768 admin admin] PATH_INFO: `/v3/projects/e3ed4ed4ec8f46369d9f49ae8b6293d9/users/1218301572c1427e9514a4663aa09878/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.125041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ab20f-2295-45b7-b108-59b1738b9a39 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.134196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.135108 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.135388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.135912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] PATH_INFO: `/v3/users/ae40d52eda054deb9ee8dbeb2d26163e` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.138901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae40d52eda054deb9ee8dbeb2d26163e)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.140403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10493-8a44-449a-aec6-1e259de5c768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ed4ed4ec8f46369d9f49ae8b6293d9, user_id=1218301572c1427e9514a4663aa09878, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.141424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.144359 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10493-8a44-449a-aec6-1e259de5c768 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.168328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 942/1895] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:26 2022] PUT /identity/v3/projects/e3ed4ed4ec8f46369d9f49ae8b6293d9/users/1218301572c1427e9514a4663aa09878/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:26.180858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0674b-377e-4c57-8563-15d13e2a4123 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.181235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0674b-377e-4c57-8563-15d13e2a4123 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.181584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0674b-377e-4c57-8563-15d13e2a4123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.195784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae40d52eda054deb9ee8dbeb2d26163e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.205180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae40d52eda054deb9ee8dbeb2d26163e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.212193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e9e0674b-377e-4c57-8563-15d13e2a4123 None None] MFA Rules not processed for user `1218301572c1427e9514a4663aa09878`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:26.213393 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e9e0674b-377e-4c57-8563-15d13e2a4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.215270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae40d52eda054deb9ee8dbeb2d26163e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.216100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae40d52eda054deb9ee8dbeb2d26163e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.217439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae40d52eda054deb9ee8dbeb2d26163e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.237860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 954/1896] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:25 2022] DELETE /identity/v3/users/ae40d52eda054deb9ee8dbeb2d26163e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:26.294653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 943/1897] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:26.295708 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.297204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.345517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0674b-377e-4c57-8563-15d13e2a4123 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.347145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e9e0674b-377e-4c57-8563-15d13e2a4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.377980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6fb55-d36d-4961-8a29-fc76b0b3a727 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.386848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d66c2-b1f8-4d0b-bb0b-67fd13d7410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.387528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d66c2-b1f8-4d0b-bb0b-67fd13d7410f admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.387820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d66c2-b1f8-4d0b-bb0b-67fd13d7410f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.388096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d66c2-b1f8-4d0b-bb0b-67fd13d7410f admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.388786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d66c2-b1f8-4d0b-bb0b-67fd13d7410f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.390724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d66c2-b1f8-4d0b-bb0b-67fd13d7410f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.422609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0674b-377e-4c57-8563-15d13e2a4123 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.423386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 955/1898] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:26 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:26.427498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d66c2-b1f8-4d0b-bb0b-67fd13d7410f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.501877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d66c2-b1f8-4d0b-bb0b-67fd13d7410f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.506708 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d7c0f-8090-4747-bda2-3a4ba53172d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.507451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d7c0f-8090-4747-bda2-3a4ba53172d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.508030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d7c0f-8090-4747-bda2-3a4ba53172d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.508138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d7c0f-8090-4747-bda2-3a4ba53172d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.508817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d7c0f-8090-4747-bda2-3a4ba53172d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.510816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d7c0f-8090-4747-bda2-3a4ba53172d5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.514208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.515147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.515431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.516331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] PATH_INFO: `/v3/users/3cbd43ad4742441e8fb4f95154d09a22` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.517667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cbd43ad4742441e8fb4f95154d09a22)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.519794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.534285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 956/1899] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:26 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:26.538890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d7c0f-8090-4747-bda2-3a4ba53172d5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.550797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d7c0f-8090-4747-bda2-3a4ba53172d5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.559746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaab43-9bdb-4b13-a1c3-d1714beae888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.560634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaab43-9bdb-4b13-a1c3-d1714beae888 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.560960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaab43-9bdb-4b13-a1c3-d1714beae888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.561245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaab43-9bdb-4b13-a1c3-d1714beae888 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.562065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eaab43-9bdb-4b13-a1c3-d1714beae888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.563996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eaab43-9bdb-4b13-a1c3-d1714beae888 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.574519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 957/1900] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:26.578515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaab43-9bdb-4b13-a1c3-d1714beae888 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.580804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cbd43ad4742441e8fb4f95154d09a22'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.588288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cbd43ad4742441e8fb4f95154d09a22'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.589822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaab43-9bdb-4b13-a1c3-d1714beae888 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.596284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461f4c8-8059-40a6-a813-79cb044312c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.596521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cbd43ad4742441e8fb4f95154d09a22'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.597164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f4c8-8059-40a6-a813-79cb044312c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.597360 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cbd43ad4742441e8fb4f95154d09a22'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.597453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f4c8-8059-40a6-a813-79cb044312c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.597803 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f4c8-8059-40a6-a813-79cb044312c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.598135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fff674d0-1974-4720-b1c0-5e2e0fe8c2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cbd43ad4742441e8fb4f95154d09a22'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.598928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461f4c8-8059-40a6-a813-79cb044312c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.600748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461f4c8-8059-40a6-a813-79cb044312c5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.619706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 958/1901] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:26.620124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 944/1902] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:26 2022] DELETE /identity/v3/users/3cbd43ad4742441e8fb4f95154d09a22 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:26.623364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461f4c8-8059-40a6-a813-79cb044312c5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.625119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d461f4c8-8059-40a6-a813-79cb044312c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.626317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1ceed-f94d-4411-b287-6437b0426716 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.626615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1ceed-f94d-4411-b287-6437b0426716 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.626897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1ceed-f94d-4411-b287-6437b0426716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.639181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461f4c8-8059-40a6-a813-79cb044312c5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.646916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-3ec1ceed-f94d-4411-b287-6437b0426716 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:26.648489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3ec1ceed-f94d-4411-b287-6437b0426716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.701702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc232-51de-456b-b475-48261b60bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.702794 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc232-51de-456b-b475-48261b60bbad admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.703077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc232-51de-456b-b475-48261b60bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.703380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc232-51de-456b-b475-48261b60bbad admin admin] PATH_INFO: `/v3/projects/9ad9baa1d7d24cc9bf6fc385fc6f08f1/users/2c88e08968734ba5a18237bb9e3497f7/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.711228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 945/1903] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:26.711891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1ceed-f94d-4411-b287-6437b0426716 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.713143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3ec1ceed-f94d-4411-b287-6437b0426716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.718627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccc232-51de-456b-b475-48261b60bbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad9baa1d7d24cc9bf6fc385fc6f08f1, user_id=2c88e08968734ba5a18237bb9e3497f7, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.721375 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccc232-51de-456b-b475-48261b60bbad admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.731127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1ceed-f94d-4411-b287-6437b0426716 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.733940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 959/1904] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:26 2022] PUT /identity/v3/projects/9ad9baa1d7d24cc9bf6fc385fc6f08f1/users/2c88e08968734ba5a18237bb9e3497f7/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:26.734849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc232-51de-456b-b475-48261b60bbad admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.736809 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-43ccc232-51de-456b-b475-48261b60bbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.786625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.787485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.787763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.788035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] PATH_INFO: `/v3/projects/74720c5cfeac40e5b21a485ad136e44d` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.789205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74720c5cfeac40e5b21a485ad136e44d)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.791153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.794808 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc232-51de-456b-b475-48261b60bbad admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.798514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10097c22-dbf3-4194-a204-57599989cc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.799169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10097c22-dbf3-4194-a204-57599989cc07 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.799434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10097c22-dbf3-4194-a204-57599989cc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.799707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10097c22-dbf3-4194-a204-57599989cc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.809568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10097c22-dbf3-4194-a204-57599989cc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.811004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10097c22-dbf3-4194-a204-57599989cc07 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.820568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 960/1905] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:26.821831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42591bb2-fcce-48f9-96ae-65bda418d574 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.822068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42591bb2-fcce-48f9-96ae-65bda418d574 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.822372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42591bb2-fcce-48f9-96ae-65bda418d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.837686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74720c5cfeac40e5b21a485ad136e44d', 'request_id': 'req-7438a0bf-1583-47f9-a8e4-8706f8912df0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.843843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74720c5cfeac40e5b21a485ad136e44d', 'request_id': 'req-7438a0bf-1583-47f9-a8e4-8706f8912df0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.849583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-42591bb2-fcce-48f9-96ae-65bda418d574 None None] MFA Rules not processed for user `2c88e08968734ba5a18237bb9e3497f7`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:26.850543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74720c5cfeac40e5b21a485ad136e44d', 'request_id': 'req-7438a0bf-1583-47f9-a8e4-8706f8912df0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.850812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-42591bb2-fcce-48f9-96ae-65bda418d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.866097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] The token cache is being invalidate because project 74720c5cfeac40e5b21a485ad136e44d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:26.866525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.867215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:26.868899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 946/1906] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:26 2022] DELETE /identity/v3/projects/74720c5cfeac40e5b21a485ad136e44d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:26.872921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.874356 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.922766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 961/1907] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:26.927120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42591bb2-fcce-48f9-96ae-65bda418d574 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:26.928567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-42591bb2-fcce-48f9-96ae-65bda418d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:26.943379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438a0bf-1583-47f9-a8e4-8706f8912df0 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:26.948509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:26.949510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:26.949944 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:26.950230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] PATH_INFO: `/v3/users/80aa8a4499a8452f9dbad62cae45e7d7` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:26.951441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80aa8a4499a8452f9dbad62cae45e7d7)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:26.953418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:26.999581 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42591bb2-fcce-48f9-96ae-65bda418d574 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.006196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2b478-8847-46eb-ac59-8e6280a21f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:27.006968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2b478-8847-46eb-ac59-8e6280a21f57 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.007251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2b478-8847-46eb-ac59-8e6280a21f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.007527 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2b478-8847-46eb-ac59-8e6280a21f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.008274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2b478-8847-46eb-ac59-8e6280a21f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:27.009531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80aa8a4499a8452f9dbad62cae45e7d7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.010266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2b478-8847-46eb-ac59-8e6280a21f57 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:27.021093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80aa8a4499a8452f9dbad62cae45e7d7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.029966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80aa8a4499a8452f9dbad62cae45e7d7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.030598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80aa8a4499a8452f9dbad62cae45e7d7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.031240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80aa8a4499a8452f9dbad62cae45e7d7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.045507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 962/1908] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:26 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:27.046849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2b478-8847-46eb-ac59-8e6280a21f57 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:27.048541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-54b2b478-8847-46eb-ac59-8e6280a21f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:27.050869 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 947/1909] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:26 2022] DELETE /identity/v3/users/80aa8a4499a8452f9dbad62cae45e7d7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:27.136803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:27.138278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:27.148231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2b478-8847-46eb-ac59-8e6280a21f57 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.275397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d61f6a-6d9b-49c1-ad77-805218afc4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:27.276356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d61f6a-6d9b-49c1-ad77-805218afc4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.276652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d61f6a-6d9b-49c1-ad77-805218afc4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.281119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d61f6a-6d9b-49c1-ad77-805218afc4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.281931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d61f6a-6d9b-49c1-ad77-805218afc4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:27.284046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d61f6a-6d9b-49c1-ad77-805218afc4c7 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:27.293874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad015b3-6db5-47f9-bead-972b56e04888 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.299624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:27.301582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.301971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.302556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] PATH_INFO: `/v3/projects/7d7cb62249d84cecb0a78cff06d0af1f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.305181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7cb62249d84cecb0a78cff06d0af1f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:27.310886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:27.349069 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 963/1910] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:27 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:27.353075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d61f6a-6d9b-49c1-ad77-805218afc4c7 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:27.367098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d61f6a-6d9b-49c1-ad77-805218afc4c7 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.372312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1742da-5091-4b41-8aac-e0e86205dfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:27.373101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1742da-5091-4b41-8aac-e0e86205dfba admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.373509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1742da-5091-4b41-8aac-e0e86205dfba admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.373890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1742da-5091-4b41-8aac-e0e86205dfba admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.374736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1742da-5091-4b41-8aac-e0e86205dfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:27.376535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1742da-5091-4b41-8aac-e0e86205dfba admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:27.397781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 964/1911] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:27.399236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1742da-5091-4b41-8aac-e0e86205dfba admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:27.406934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7cb62249d84cecb0a78cff06d0af1f', 'request_id': 'req-79accf06-9a11-418d-a1b8-075970343eee'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.410850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1742da-5091-4b41-8aac-e0e86205dfba admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.416468 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7cb62249d84cecb0a78cff06d0af1f', 'request_id': 'req-79accf06-9a11-418d-a1b8-075970343eee'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.424460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7cb62249d84cecb0a78cff06d0af1f', 'request_id': 'req-79accf06-9a11-418d-a1b8-075970343eee'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.449718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] The token cache is being invalidate because project 7d7cb62249d84cecb0a78cff06d0af1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:27.451029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.451884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.456623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 948/1912] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:27 2022] DELETE /identity/v3/projects/7d7cb62249d84cecb0a78cff06d0af1f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:27.456623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:27.459312 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:27.493455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702db9b-d153-4133-853f-1bc8adf0ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:27.494444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702db9b-d153-4133-853f-1bc8adf0ea2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.495177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702db9b-d153-4133-853f-1bc8adf0ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.495898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702db9b-d153-4133-853f-1bc8adf0ea2e admin admin] PATH_INFO: `/v3/projects/47fb8708cedd4369a37af64b2f1765ee/users/00f5e6ff211545b292af9098011c41d3/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.516479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702db9b-d153-4133-853f-1bc8adf0ea2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47fb8708cedd4369a37af64b2f1765ee, user_id=00f5e6ff211545b292af9098011c41d3, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:27.519371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702db9b-d153-4133-853f-1bc8adf0ea2e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:27.540938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 965/1913] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:27 2022] PUT /identity/v3/projects/47fb8708cedd4369a37af64b2f1765ee/users/00f5e6ff211545b292af9098011c41d3/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:27.544394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702db9b-d153-4133-853f-1bc8adf0ea2e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:27.544394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7702db9b-d153-4133-853f-1bc8adf0ea2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:27.557619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79accf06-9a11-418d-a1b8-075970343eee admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.618297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702db9b-d153-4133-853f-1bc8adf0ea2e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.627635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:27.628535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.628822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.629099 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] PATH_INFO: `/v3/users/15a39b6f08124daeba1f442aa321f7d1` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.630865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a39b6f08124daeba1f442aa321f7d1)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:27.632773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:27.634160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:27.636167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.636615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.637644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] PATH_INFO: `/v3/users/e9e971ad42cd4519af8d79228ae4c253` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.639414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e971ad42cd4519af8d79228ae4c253)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:27.641504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:27.689573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a39b6f08124daeba1f442aa321f7d1'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.699351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a39b6f08124daeba1f442aa321f7d1'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.708316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a39b6f08124daeba1f442aa321f7d1'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.709551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a39b6f08124daeba1f442aa321f7d1'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.710458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a39b6f08124daeba1f442aa321f7d1'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.712399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e971ad42cd4519af8d79228ae4c253'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.721176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e971ad42cd4519af8d79228ae4c253'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.730027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e971ad42cd4519af8d79228ae4c253'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.731175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e971ad42cd4519af8d79228ae4c253'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.731731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e971ad42cd4519af8d79228ae4c253'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:27.735723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 966/1914] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:27 2022] DELETE /identity/v3/users/15a39b6f08124daeba1f442aa321f7d1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:27.735723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:27.761235 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:27.766367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 949/1915] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:27 2022] DELETE /identity/v3/users/e9e971ad42cd4519af8d79228ae4c253 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:27.769586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:27.770558 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:27.860049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170abdff-abbc-4ee0-901c-5b3af5992db7 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.873258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa72f9-edf3-4a32-b5c6-ff3ec883550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:27.873974 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa72f9-edf3-4a32-b5c6-ff3ec883550f admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.875722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa72f9-edf3-4a32-b5c6-ff3ec883550f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.876095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa72f9-edf3-4a32-b5c6-ff3ec883550f admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.877143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa72f9-edf3-4a32-b5c6-ff3ec883550f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:27.879102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa72f9-edf3-4a32-b5c6-ff3ec883550f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:27.884287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1078f-1b1a-4321-a3e9-a72f6d7eec54 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.894516 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:27.895700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.896171 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 950/1916] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:27.896531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.896823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] PATH_INFO: `/v3/projects/27b210a5a7a94e08a0a519dcc2e26213` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.897578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8c720-fd97-4eb4-a2af-76cf995869f2 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:27.897873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8c720-fd97-4eb4-a2af-76cf995869f2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:27.898135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8c720-fd97-4eb4-a2af-76cf995869f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:27.899613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b210a5a7a94e08a0a519dcc2e26213)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:27.907672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:27.948284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-8ad8c720-fd97-4eb4-a2af-76cf995869f2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:27.950284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8ad8c720-fd97-4eb4-a2af-76cf995869f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:27.964991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 951/1917] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:27.964991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8c720-fd97-4eb4-a2af-76cf995869f2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:27.978452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8c720-fd97-4eb4-a2af-76cf995869f2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:27.994376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b210a5a7a94e08a0a519dcc2e26213', 'request_id': 'req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.005597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b210a5a7a94e08a0a519dcc2e26213', 'request_id': 'req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.013219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b210a5a7a94e08a0a519dcc2e26213', 'request_id': 'req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.027599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] The token cache is being invalidate because project 27b210a5a7a94e08a0a519dcc2e26213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:28.027939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.028726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.030439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 967/1918] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:27 2022] DELETE /identity/v3/projects/27b210a5a7a94e08a0a519dcc2e26213 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:28.038874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.040469 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.067999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66028fd3-14ea-4490-8783-e5093e854788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.069149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028fd3-14ea-4490-8783-e5093e854788 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.069538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028fd3-14ea-4490-8783-e5093e854788 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.069921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66028fd3-14ea-4490-8783-e5093e854788 admin admin] PATH_INFO: `/v3/projects/47fb8708cedd4369a37af64b2f1765ee/users/00f5e6ff211545b292af9098011c41d3/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.072627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66028fd3-14ea-4490-8783-e5093e854788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47fb8708cedd4369a37af64b2f1765ee, user_id=00f5e6ff211545b292af9098011c41d3, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.075808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66028fd3-14ea-4490-8783-e5093e854788 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.093775 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 952/1919] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:27 2022] PUT /identity/v3/projects/47fb8708cedd4369a37af64b2f1765ee/users/00f5e6ff211545b292af9098011c41d3/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:28.095160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46987-0bcb-43f4-b297-0c32a766727d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.095441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46987-0bcb-43f4-b297-0c32a766727d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.095723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46987-0bcb-43f4-b297-0c32a766727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.117308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-29e46987-0bcb-43f4-b297-0c32a766727d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:28.118743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-29e46987-0bcb-43f4-b297-0c32a766727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.126822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad979a-34cf-4d1c-a010-afcbfc81ea6f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.198459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b354aab-a18d-46d2-8a01-8e190e502042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.199121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b354aab-a18d-46d2-8a01-8e190e502042 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.199403 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b354aab-a18d-46d2-8a01-8e190e502042 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.199812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b354aab-a18d-46d2-8a01-8e190e502042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.201908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6b354aab-a18d-46d2-8a01-8e190e502042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.216461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 953/1920] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:28.216461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980bc0e-6b94-443d-ab90-c18331872338 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.216461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980bc0e-6b94-443d-ab90-c18331872338 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.216461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5980bc0e-6b94-443d-ab90-c18331872338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.216853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b354aab-a18d-46d2-8a01-8e190e502042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.218551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b354aab-a18d-46d2-8a01-8e190e502042 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.229412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 968/1921] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:28.230787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3486cfa-0207-4c70-81c5-370f981458ad None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.231079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3486cfa-0207-4c70-81c5-370f981458ad None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.231362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3486cfa-0207-4c70-81c5-370f981458ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.245678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5980bc0e-6b94-443d-ab90-c18331872338 None None] MFA Rules not processed for user `00f5e6ff211545b292af9098011c41d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:28.248526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5980bc0e-6b94-443d-ab90-c18331872338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.253955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b3486cfa-0207-4c70-81c5-370f981458ad None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:28.255298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b3486cfa-0207-4c70-81c5-370f981458ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.265153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 969/1922] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:28.271133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3486cfa-0207-4c70-81c5-370f981458ad None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.282880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3486cfa-0207-4c70-81c5-370f981458ad None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.289709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12212d6-80d1-4525-b904-629380745eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.291026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12212d6-80d1-4525-b904-629380745eea admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.291026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12212d6-80d1-4525-b904-629380745eea admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.294517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12212d6-80d1-4525-b904-629380745eea admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.295320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12212d6-80d1-4525-b904-629380745eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:28.295643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12212d6-80d1-4525-b904-629380745eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.299119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12212d6-80d1-4525-b904-629380745eea admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.320404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 970/1923] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:28.322136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12212d6-80d1-4525-b904-629380745eea admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.334554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12212d6-80d1-4525-b904-629380745eea admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.340021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459820c8-dca5-4efc-a921-28a4458f86c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.340860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459820c8-dca5-4efc-a921-28a4458f86c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.341141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459820c8-dca5-4efc-a921-28a4458f86c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.341420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459820c8-dca5-4efc-a921-28a4458f86c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.342120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459820c8-dca5-4efc-a921-28a4458f86c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.344382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459820c8-dca5-4efc-a921-28a4458f86c4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.359642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 954/1924] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:28.372558 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980bc0e-6b94-443d-ab90-c18331872338 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.375094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5980bc0e-6b94-443d-ab90-c18331872338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.388758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 971/1925] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:28 2022] POST /identity/v3/projects => generated 409 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:28.392769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459820c8-dca5-4efc-a921-28a4458f86c4 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.464106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5980bc0e-6b94-443d-ab90-c18331872338 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.496257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459820c8-dca5-4efc-a921-28a4458f86c4 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.503551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb783ce-2d3e-4fdb-9cff-78be7e1423ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.505238 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb783ce-2d3e-4fdb-9cff-78be7e1423ef admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.505717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb783ce-2d3e-4fdb-9cff-78be7e1423ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.506476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb783ce-2d3e-4fdb-9cff-78be7e1423ef admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.507358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb783ce-2d3e-4fdb-9cff-78be7e1423ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.509658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb783ce-2d3e-4fdb-9cff-78be7e1423ef admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.551780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b49d35-bde5-4b63-9956-51e7955eb272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.552367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49d35-bde5-4b63-9956-51e7955eb272 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.552479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 972/1926] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:28 2022] POST /identity/v3/users => generated 305 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:28.552912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49d35-bde5-4b63-9956-51e7955eb272 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.553676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb783ce-2d3e-4fdb-9cff-78be7e1423ef admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.556602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b49d35-bde5-4b63-9956-51e7955eb272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.557997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fbb783ce-2d3e-4fdb-9cff-78be7e1423ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.574241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb783ce-2d3e-4fdb-9cff-78be7e1423ef admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.579422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.580710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.581409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.581409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] PATH_INFO: `/v3/projects/7fb1f7f332ab4bf59125a8e9ae442423` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.582717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb1f7f332ab4bf59125a8e9ae442423)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.585263 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.648552 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb1f7f332ab4bf59125a8e9ae442423', 'request_id': 'req-154c5ceb-0473-46b5-b88e-853b9ed6e44f'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.664064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b49d35-bde5-4b63-9956-51e7955eb272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.665740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b49d35-bde5-4b63-9956-51e7955eb272 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.671446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb1f7f332ab4bf59125a8e9ae442423', 'request_id': 'req-154c5ceb-0473-46b5-b88e-853b9ed6e44f'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.690101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb1f7f332ab4bf59125a8e9ae442423', 'request_id': 'req-154c5ceb-0473-46b5-b88e-853b9ed6e44f'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.705025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 955/1927] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:28.705916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b49d35-bde5-4b63-9956-51e7955eb272 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.715186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] The token cache is being invalidate because project 7fb1f7f332ab4bf59125a8e9ae442423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:28.715475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.716581 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.718435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 973/1928] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:28 2022] DELETE /identity/v3/projects/7fb1f7f332ab4bf59125a8e9ae442423 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:28.718978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.720306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.725448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b49d35-bde5-4b63-9956-51e7955eb272 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.786947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36bfd-07fd-41b3-a63e-43c60f69f702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.787711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36bfd-07fd-41b3-a63e-43c60f69f702 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.787956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36bfd-07fd-41b3-a63e-43c60f69f702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.788259 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36bfd-07fd-41b3-a63e-43c60f69f702 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.789012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba36bfd-07fd-41b3-a63e-43c60f69f702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.790666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba36bfd-07fd-41b3-a63e-43c60f69f702 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.796193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c5ceb-0473-46b5-b88e-853b9ed6e44f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.801561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.801905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 956/1929] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:28.802455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.802747 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.803028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] PATH_INFO: `/v3/projects/d074a30183d14c64a22296d1bb39b0d1` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.803132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36bfd-07fd-41b3-a63e-43c60f69f702 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.805427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d074a30183d14c64a22296d1bb39b0d1)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.805639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-dba36bfd-07fd-41b3-a63e-43c60f69f702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.807392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.819686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36bfd-07fd-41b3-a63e-43c60f69f702 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.824746 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:28.825723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:28.826084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:28.826464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] PATH_INFO: `/v3/users/bc3dc6b8b6da4eacb48be962f973bea7` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:28.827754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3dc6b8b6da4eacb48be962f973bea7)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:28.829739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:28.870596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd074a30183d14c64a22296d1bb39b0d1', 'request_id': 'req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.878613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd074a30183d14c64a22296d1bb39b0d1', 'request_id': 'req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.885635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3dc6b8b6da4eacb48be962f973bea7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.886785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd074a30183d14c64a22296d1bb39b0d1', 'request_id': 'req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.895819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3dc6b8b6da4eacb48be962f973bea7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.898047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] The token cache is being invalidate because project d074a30183d14c64a22296d1bb39b0d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:28.898559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.899329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.901606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 974/1930] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:28 2022] DELETE /identity/v3/projects/d074a30183d14c64a22296d1bb39b0d1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:28.903575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.904986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.910689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3dc6b8b6da4eacb48be962f973bea7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.911434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3dc6b8b6da4eacb48be962f973bea7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.912058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3dc6b8b6da4eacb48be962f973bea7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:28.930620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 957/1931] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:28 2022] DELETE /identity/v3/users/bc3dc6b8b6da4eacb48be962f973bea7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:28.931418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:28.932739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:28.980446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fefb37-d8ba-4d33-a15c-d4b99b5033ba admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:28.999219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01180963-8d65-4812-a5a6-25fc1c7d3df5 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.004912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5f684-8985-44b1-b0ae-37835e744d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.005656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5f684-8985-44b1-b0ae-37835e744d61 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.006007 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5f684-8985-44b1-b0ae-37835e744d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.006382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5f684-8985-44b1-b0ae-37835e744d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.007173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5f684-8985-44b1-b0ae-37835e744d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.008857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5f684-8985-44b1-b0ae-37835e744d61 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.019245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 958/1932] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:29.020565 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5f684-8985-44b1-b0ae-37835e744d61 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.022198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-eec5f684-8985-44b1-b0ae-37835e744d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.035372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eeb51-6b30-4ac8-a347-fa59afc519fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.036156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eeb51-6b30-4ac8-a347-fa59afc519fc service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.036524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eeb51-6b30-4ac8-a347-fa59afc519fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.036879 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eeb51-6b30-4ac8-a347-fa59afc519fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.037435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5f684-8985-44b1-b0ae-37835e744d61 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.039245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a93eeb51-6b30-4ac8-a347-fa59afc519fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.042586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.043521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.044091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.044091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] PATH_INFO: `/v3/users/c5e4834526384450a45534660106ba24` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.045271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e4834526384450a45534660106ba24)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.047220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.106824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eeb51-6b30-4ac8-a347-fa59afc519fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.108385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eeb51-6b30-4ac8-a347-fa59afc519fc service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.109930 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e4834526384450a45534660106ba24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.117088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e4834526384450a45534660106ba24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.117764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 975/1933] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:29.118592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eeb51-6b30-4ac8-a347-fa59afc519fc service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.129903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e4834526384450a45534660106ba24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.131071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e4834526384450a45534660106ba24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.131717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4b3313ba-fc56-4735-8a12-bf0061a4b871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e4834526384450a45534660106ba24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.132080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eeb51-6b30-4ac8-a347-fa59afc519fc service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.137323 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf0ac1-8227-47b9-a23c-5d6986a004d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.138728 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf0ac1-8227-47b9-a23c-5d6986a004d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.139086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf0ac1-8227-47b9-a23c-5d6986a004d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.139501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf0ac1-8227-47b9-a23c-5d6986a004d9 admin admin] PATH_INFO: `/v3/projects/6fccffe09802464d82f812f6413c8b75/users/3be143a327914afc9252f7190a1c1759/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.161214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 959/1934] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:29 2022] DELETE /identity/v3/users/c5e4834526384450a45534660106ba24 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:29.169841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf0ac1-8227-47b9-a23c-5d6986a004d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fccffe09802464d82f812f6413c8b75, user_id=3be143a327914afc9252f7190a1c1759, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.172689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf0ac1-8227-47b9-a23c-5d6986a004d9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.210862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 976/1935] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:29 2022] PUT /identity/v3/projects/6fccffe09802464d82f812f6413c8b75/users/3be143a327914afc9252f7190a1c1759/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:29.214986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfdffe-b6b3-47a9-aeee-1c4302fafd39 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.215594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfdffe-b6b3-47a9-aeee-1c4302fafd39 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.216276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfdffe-b6b3-47a9-aeee-1c4302fafd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.234195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf0ac1-8227-47b9-a23c-5d6986a004d9 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.236365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3dcf0ac1-8227-47b9-a23c-5d6986a004d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.259205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-75cfdffe-b6b3-47a9-aeee-1c4302fafd39 None None] MFA Rules not processed for user `3be143a327914afc9252f7190a1c1759`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:29.260681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-75cfdffe-b6b3-47a9-aeee-1c4302fafd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.339126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf0ac1-8227-47b9-a23c-5d6986a004d9 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.344146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.345023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.345309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.345585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] PATH_INFO: `/v3/projects/15ebf6d69be1485d9331082882a795b7` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.346811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=15ebf6d69be1485d9331082882a795b7)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.349324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.362548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 960/1936] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:29.365486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfdffe-b6b3-47a9-aeee-1c4302fafd39 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.368191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-75cfdffe-b6b3-47a9-aeee-1c4302fafd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.390903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfdffe-b6b3-47a9-aeee-1c4302fafd39 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.396957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68889aee-5f22-4607-b62d-bb7383b87f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.397810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68889aee-5f22-4607-b62d-bb7383b87f01 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.398185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68889aee-5f22-4607-b62d-bb7383b87f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.398592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68889aee-5f22-4607-b62d-bb7383b87f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.399379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68889aee-5f22-4607-b62d-bb7383b87f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.402318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68889aee-5f22-4607-b62d-bb7383b87f01 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.421988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15ebf6d69be1485d9331082882a795b7', 'request_id': 'req-cfc7eb11-9ed7-419b-9348-c7e93336b34e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.430456 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15ebf6d69be1485d9331082882a795b7', 'request_id': 'req-cfc7eb11-9ed7-419b-9348-c7e93336b34e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.436909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 961/1937] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:29 2022] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:29.437527 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15ebf6d69be1485d9331082882a795b7', 'request_id': 'req-cfc7eb11-9ed7-419b-9348-c7e93336b34e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.440865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68889aee-5f22-4607-b62d-bb7383b87f01 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.452819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] The token cache is being invalidate because project 15ebf6d69be1485d9331082882a795b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:29.453304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.453969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cfc7eb11-9ed7-419b-9348-c7e93336b34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.456975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 977/1938] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:29 2022] DELETE /identity/v3/projects/15ebf6d69be1485d9331082882a795b7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:29.463383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe8a2-cec1-4f4b-81e4-27d881fcd212 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.464002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe8a2-cec1-4f4b-81e4-27d881fcd212 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.464976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbe8a2-cec1-4f4b-81e4-27d881fcd212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.489781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e3bbe8a2-cec1-4f4b-81e4-27d881fcd212 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:29.491031 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e3bbe8a2-cec1-4f4b-81e4-27d881fcd212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.519519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68889aee-5f22-4607-b62d-bb7383b87f01 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.526575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7ecea-add1-495e-bc70-538ac737d887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.527587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7ecea-add1-495e-bc70-538ac737d887 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.527766 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7ecea-add1-495e-bc70-538ac737d887 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.528308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7ecea-add1-495e-bc70-538ac737d887 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.529111 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7ecea-add1-495e-bc70-538ac737d887 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.531187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7ecea-add1-495e-bc70-538ac737d887 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.587610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 962/1939] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:29 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:29.588470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7ecea-add1-495e-bc70-538ac737d887 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.590274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-83d7ecea-add1-495e-bc70-538ac737d887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.592911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 978/1940] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:29.594127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe8a2-cec1-4f4b-81e4-27d881fcd212 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.595711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e3bbe8a2-cec1-4f4b-81e4-27d881fcd212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.609810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7ecea-add1-495e-bc70-538ac737d887 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.610821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbe8a2-cec1-4f4b-81e4-27d881fcd212 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.615530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.616631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.616902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.617185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] PATH_INFO: `/v3/projects/1bcb7b7ba1f34f8e833a6d84877af488` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.618051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1ccec-f491-425c-87d4-6cce4dade592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.618424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bcb7b7ba1f34f8e833a6d84877af488)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.618947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1ccec-f491-425c-87d4-6cce4dade592 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.619387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1ccec-f491-425c-87d4-6cce4dade592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.619670 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1ccec-f491-425c-87d4-6cce4dade592 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.620523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1ccec-f491-425c-87d4-6cce4dade592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.620647 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.622385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab1ccec-f491-425c-87d4-6cce4dade592 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.633309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 979/1941] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:29.634535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc37f6-212c-4832-bd29-dbf6273fc9a6 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.634893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc37f6-212c-4832-bd29-dbf6273fc9a6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.635261 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc37f6-212c-4832-bd29-dbf6273fc9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.655622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c0bc37f6-212c-4832-bd29-dbf6273fc9a6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:29.657272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c0bc37f6-212c-4832-bd29-dbf6273fc9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.669305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 980/1942] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:29.670235 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc37f6-212c-4832-bd29-dbf6273fc9a6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.680386 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc37f6-212c-4832-bd29-dbf6273fc9a6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.681815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcb7b7ba1f34f8e833a6d84877af488', 'request_id': 'req-628361a4-d277-4562-8c22-d26bae1c2f13'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.689277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcb7b7ba1f34f8e833a6d84877af488', 'request_id': 'req-628361a4-d277-4562-8c22-d26bae1c2f13'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.696849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcb7b7ba1f34f8e833a6d84877af488', 'request_id': 'req-628361a4-d277-4562-8c22-d26bae1c2f13'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.724473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] The token cache is being invalidate because project 1bcb7b7ba1f34f8e833a6d84877af488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:29.724759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.725428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:29.727257 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 963/1943] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:29 2022] DELETE /identity/v3/projects/1bcb7b7ba1f34f8e833a6d84877af488 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:29.731353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.732722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.753332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ce8ba-073e-47c1-9c4c-db20c5f9cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.754575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ce8ba-073e-47c1-9c4c-db20c5f9cf88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.754859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ce8ba-073e-47c1-9c4c-db20c5f9cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.755141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ce8ba-073e-47c1-9c4c-db20c5f9cf88 admin admin] PATH_INFO: `/v3/projects/d233835b6dcf40558c0320b960ecfb98/users/ce17051e47214834bb1d750aa90a68cb/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.773924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ce8ba-073e-47c1-9c4c-db20c5f9cf88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d233835b6dcf40558c0320b960ecfb98, user_id=ce17051e47214834bb1d750aa90a68cb, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.776782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ce8ba-073e-47c1-9c4c-db20c5f9cf88 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.797253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 981/1944] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:29 2022] PUT /identity/v3/projects/d233835b6dcf40558c0320b960ecfb98/users/ce17051e47214834bb1d750aa90a68cb/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:29.798998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2067fe-872d-4274-bf43-fff3a93533b9 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.799496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2067fe-872d-4274-bf43-fff3a93533b9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.800228 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2067fe-872d-4274-bf43-fff3a93533b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.815733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628361a4-d277-4562-8c22-d26bae1c2f13 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.822100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ad2067fe-872d-4274-bf43-fff3a93533b9 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:29.823907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ad2067fe-872d-4274-bf43-fff3a93533b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.877398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.878059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.878370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.878649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.879903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:29.880209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.881820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.892800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 964/1945] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:29.893665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.896403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:29.898865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 982/1946] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:29.899682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2067fe-872d-4274-bf43-fff3a93533b9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.909988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2067fe-872d-4274-bf43-fff3a93533b9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.912348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cd200-b7f3-4d70-9cd7-3c0cd441915b admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:29.914601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331774c-061f-4920-a621-5b1d76a4496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.915240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331774c-061f-4920-a621-5b1d76a4496a admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.915531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331774c-061f-4920-a621-5b1d76a4496a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.915813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331774c-061f-4920-a621-5b1d76a4496a admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.916491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331774c-061f-4920-a621-5b1d76a4496a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.917220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb6b03-50fd-403f-9c90-00c4538c224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:29.917946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6b03-50fd-403f-9c90-00c4538c224e admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.918318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6b03-50fd-403f-9c90-00c4538c224e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.918411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331774c-061f-4920-a621-5b1d76a4496a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.918665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb6b03-50fd-403f-9c90-00c4538c224e admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.919379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb6b03-50fd-403f-9c90-00c4538c224e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:29.920931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb6b03-50fd-403f-9c90-00c4538c224e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:29.931735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 965/1947] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:29.932709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ac6a6-a428-4156-abd7-82f90232817f None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:29.933149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ac6a6-a428-4156-abd7-82f90232817f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:29.933434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ac6a6-a428-4156-abd7-82f90232817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:29.949915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 983/1948] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:29 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:29.950663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331774c-061f-4920-a621-5b1d76a4496a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:29.951883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0e6ac6a6-a428-4156-abd7-82f90232817f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:29.953074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0e6ac6a6-a428-4156-abd7-82f90232817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:30.017103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331774c-061f-4920-a621-5b1d76a4496a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.017339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 966/1949] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:30.018484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ac6a6-a428-4156-abd7-82f90232817f None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.022504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64b65c-c0b8-4df4-a9ed-b9091d2a9403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.023387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b65c-c0b8-4df4-a9ed-b9091d2a9403 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.023665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b65c-c0b8-4df4-a9ed-b9091d2a9403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.023934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff64b65c-c0b8-4df4-a9ed-b9091d2a9403 admin admin] PATH_INFO: `/v3/projects/d233835b6dcf40558c0320b960ecfb98/users/ce17051e47214834bb1d750aa90a68cb/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.025928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64b65c-c0b8-4df4-a9ed-b9091d2a9403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d233835b6dcf40558c0320b960ecfb98, user_id=ce17051e47214834bb1d750aa90a68cb, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.028162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ac6a6-a428-4156-abd7-82f90232817f None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.028857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff64b65c-c0b8-4df4-a9ed-b9091d2a9403 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.033214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa386229-a966-494a-bcc4-61ce96cc60a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.033980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386229-a966-494a-bcc4-61ce96cc60a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.034364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386229-a966-494a-bcc4-61ce96cc60a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.034710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386229-a966-494a-bcc4-61ce96cc60a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.036019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa386229-a966-494a-bcc4-61ce96cc60a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.037971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa386229-a966-494a-bcc4-61ce96cc60a6 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.048545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 984/1950] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:29 2022] PUT /identity/v3/projects/d233835b6dcf40558c0320b960ecfb98/users/ce17051e47214834bb1d750aa90a68cb/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:30.048545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64b65c-c0b8-4df4-a9ed-b9091d2a9403 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.059341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 967/1951] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:30 2022] POST /identity/v3/users => generated 282 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:30.060826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efebf88-7091-4e71-a1cd-4650e0a71bb1 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.061117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efebf88-7091-4e71-a1cd-4650e0a71bb1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.061399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efebf88-7091-4e71-a1cd-4650e0a71bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.091790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-4efebf88-7091-4e71-a1cd-4650e0a71bb1 None None] MFA Rules not processed for user `ce17051e47214834bb1d750aa90a68cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:30.093292 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4efebf88-7091-4e71-a1cd-4650e0a71bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:30.116711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff64b65c-c0b8-4df4-a9ed-b9091d2a9403 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.121319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db010-850c-4ba1-ac58-824d89286097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.121981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db010-850c-4ba1-ac58-824d89286097 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.122349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db010-850c-4ba1-ac58-824d89286097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.122632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db010-850c-4ba1-ac58-824d89286097 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.123366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432db010-850c-4ba1-ac58-824d89286097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:30.123669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432db010-850c-4ba1-ac58-824d89286097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.125255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432db010-850c-4ba1-ac58-824d89286097 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.136957 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 985/1952] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:30.137594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db010-850c-4ba1-ac58-824d89286097 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.150379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db010-850c-4ba1-ac58-824d89286097 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.155817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3553fa-b619-49e3-a33d-3b666ece4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.156479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3553fa-b619-49e3-a33d-3b666ece4432 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.156767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3553fa-b619-49e3-a33d-3b666ece4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.157045 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3553fa-b619-49e3-a33d-3b666ece4432 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.157770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3553fa-b619-49e3-a33d-3b666ece4432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.159369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3553fa-b619-49e3-a33d-3b666ece4432 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.168312 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 968/1953] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:30.169158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efebf88-7091-4e71-a1cd-4650e0a71bb1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.173943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 986/1954] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:30.178090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3553fa-b619-49e3-a33d-3b666ece4432 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.179855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efebf88-7091-4e71-a1cd-4650e0a71bb1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.184585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ae3a-e465-4d2d-bb8c-a140facb1447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.185336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ae3a-e465-4d2d-bb8c-a140facb1447 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.185690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ae3a-e465-4d2d-bb8c-a140facb1447 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.185966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3588ae3a-e465-4d2d-bb8c-a140facb1447 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.186687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ae3a-e465-4d2d-bb8c-a140facb1447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.188592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3588ae3a-e465-4d2d-bb8c-a140facb1447 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.188929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3553fa-b619-49e3-a33d-3b666ece4432 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.194572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8daca-7e75-42ab-b0a4-3209dd71330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.195176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8daca-7e75-42ab-b0a4-3209dd71330a admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.195463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8daca-7e75-42ab-b0a4-3209dd71330a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.195746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8daca-7e75-42ab-b0a4-3209dd71330a admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.196467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8daca-7e75-42ab-b0a4-3209dd71330a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.198086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8daca-7e75-42ab-b0a4-3209dd71330a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.211954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 987/1955] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:30.211954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8daca-7e75-42ab-b0a4-3209dd71330a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.211954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7fb8daca-7e75-42ab-b0a4-3209dd71330a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:30.214329 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 969/1956] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:30 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:30.215174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ae3a-e465-4d2d-bb8c-a140facb1447 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.275260 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8daca-7e75-42ab-b0a4-3209dd71330a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.283267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3588ae3a-e465-4d2d-bb8c-a140facb1447 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.288984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3c294-f776-407a-9f61-8c7a445543d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.289911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3c294-f776-407a-9f61-8c7a445543d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.290193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3c294-f776-407a-9f61-8c7a445543d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.290919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3c294-f776-407a-9f61-8c7a445543d0 admin admin] PATH_INFO: `/v3/projects/83f3c6bf5e284e8eba3f9c72540ad8b1/users/d825058cec6f40178f74ddb5558cbf61/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.307592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3c294-f776-407a-9f61-8c7a445543d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f3c6bf5e284e8eba3f9c72540ad8b1, user_id=d825058cec6f40178f74ddb5558cbf61, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.310492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3c294-f776-407a-9f61-8c7a445543d0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.324357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 970/1957] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:30 2022] PUT /identity/v3/projects/83f3c6bf5e284e8eba3f9c72540ad8b1/users/d825058cec6f40178f74ddb5558cbf61/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:30.331194 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3c294-f776-407a-9f61-8c7a445543d0 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.344435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d700d-f690-484f-b335-a4f4866365df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.345277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d700d-f690-484f-b335-a4f4866365df service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.345613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d700d-f690-484f-b335-a4f4866365df service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.345978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d700d-f690-484f-b335-a4f4866365df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.406474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3c294-f776-407a-9f61-8c7a445543d0 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.411906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0b31e-8f7a-4748-90bd-b94eaee606a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.412590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0b31e-8f7a-4748-90bd-b94eaee606a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.412872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0b31e-8f7a-4748-90bd-b94eaee606a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.413142 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0b31e-8f7a-4748-90bd-b94eaee606a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.413823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0b31e-8f7a-4748-90bd-b94eaee606a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.415754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0b31e-8f7a-4748-90bd-b94eaee606a9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.425548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d700d-f690-484f-b335-a4f4866365df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.427065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d700d-f690-484f-b335-a4f4866365df service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.434839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 971/1958] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:30 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:30.436117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d362d67-e5c7-4bd5-8346-dab1c9027fc5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.436411 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d362d67-e5c7-4bd5-8346-dab1c9027fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.436738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d362d67-e5c7-4bd5-8346-dab1c9027fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.437144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 988/1959] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:30.438817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d700d-f690-484f-b335-a4f4866365df service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.449262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d700d-f690-484f-b335-a4f4866365df service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.453877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd829f-462d-42c5-b9c5-7051d1a7bed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.454566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd829f-462d-42c5-b9c5-7051d1a7bed6 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.454848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd829f-462d-42c5-b9c5-7051d1a7bed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.455181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd829f-462d-42c5-b9c5-7051d1a7bed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.455895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd829f-462d-42c5-b9c5-7051d1a7bed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.458470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd829f-462d-42c5-b9c5-7051d1a7bed6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.464629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-3d362d67-e5c7-4bd5-8346-dab1c9027fc5 None None] MFA Rules not processed for user `d825058cec6f40178f74ddb5558cbf61`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:30.465843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3d362d67-e5c7-4bd5-8346-dab1c9027fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:30.470318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 989/1960] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:30.473595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd829f-462d-42c5-b9c5-7051d1a7bed6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.484384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd829f-462d-42c5-b9c5-7051d1a7bed6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.489858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32692eb9-cd1c-4878-afa9-93016cf923e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.490644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32692eb9-cd1c-4878-afa9-93016cf923e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.491073 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32692eb9-cd1c-4878-afa9-93016cf923e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.491469 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32692eb9-cd1c-4878-afa9-93016cf923e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.492262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32692eb9-cd1c-4878-afa9-93016cf923e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.493849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32692eb9-cd1c-4878-afa9-93016cf923e7 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.508408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 990/1961] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:30.511265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32692eb9-cd1c-4878-afa9-93016cf923e7 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.521451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32692eb9-cd1c-4878-afa9-93016cf923e7 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.527234 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eec2f7-fea7-4ebd-a29d-d0a0afbb9224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.528233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eec2f7-fea7-4ebd-a29d-d0a0afbb9224 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.528805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eec2f7-fea7-4ebd-a29d-d0a0afbb9224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.528805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eec2f7-fea7-4ebd-a29d-d0a0afbb9224 admin admin] PATH_INFO: `/v3/projects/04633abbfc244dae9c112c54d038c561/users/41b9f23a0c904d2dae33c3c7f03535a3/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.538975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 972/1962] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:30.547029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eec2f7-fea7-4ebd-a29d-d0a0afbb9224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04633abbfc244dae9c112c54d038c561, user_id=41b9f23a0c904d2dae33c3c7f03535a3, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.548809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d362d67-e5c7-4bd5-8346-dab1c9027fc5 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.550961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eec2f7-fea7-4ebd-a29d-d0a0afbb9224 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.564854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 991/1963] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:30 2022] PUT /identity/v3/projects/04633abbfc244dae9c112c54d038c561/users/41b9f23a0c904d2dae33c3c7f03535a3/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:30.575624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9dd80-b966-4f3c-bd45-f593626f3cb9 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.575916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9dd80-b966-4f3c-bd45-f593626f3cb9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.576209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9dd80-b966-4f3c-bd45-f593626f3cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.605606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f2e9dd80-b966-4f3c-bd45-f593626f3cb9 None None] MFA Rules not processed for user `41b9f23a0c904d2dae33c3c7f03535a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:30.606844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f2e9dd80-b966-4f3c-bd45-f593626f3cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:30.610836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d362d67-e5c7-4bd5-8346-dab1c9027fc5 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.658337 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afd04a-923b-4018-be94-98f7f6da9a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.659032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd04a-923b-4018-be94-98f7f6da9a2a service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.659323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd04a-923b-4018-be94-98f7f6da9a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.659599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd04a-923b-4018-be94-98f7f6da9a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.670220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 992/1964] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:30.670725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9dd80-b966-4f3c-bd45-f593626f3cb9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.671954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f2e9dd80-b966-4f3c-bd45-f593626f3cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:30.683671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9dd80-b966-4f3c-bd45-f593626f3cb9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.689628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e812af-b88a-4356-922d-936a38d1edd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.690783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e812af-b88a-4356-922d-936a38d1edd1 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.691285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e812af-b88a-4356-922d-936a38d1edd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.692322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e812af-b88a-4356-922d-936a38d1edd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.695147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-97e812af-b88a-4356-922d-936a38d1edd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:30.717183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afd04a-923b-4018-be94-98f7f6da9a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.718643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afd04a-923b-4018-be94-98f7f6da9a2a service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.727606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 973/1965] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:30 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:30.728390 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afd04a-923b-4018-be94-98f7f6da9a2a service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.752564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e812af-b88a-4356-922d-936a38d1edd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.753992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e812af-b88a-4356-922d-936a38d1edd1 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.763411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 993/1966] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:30.790557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afd04a-923b-4018-be94-98f7f6da9a2a service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.795565 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0616b-b820-40af-96d1-257ad7832f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.796228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0616b-b820-40af-96d1-257ad7832f86 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.796743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0616b-b820-40af-96d1-257ad7832f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.796909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0616b-b820-40af-96d1-257ad7832f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.797604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0616b-b820-40af-96d1-257ad7832f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.799543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0616b-b820-40af-96d1-257ad7832f86 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:30.832900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 974/1967] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:30 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:30.834009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e812af-b88a-4356-922d-936a38d1edd1 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:30.845466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e812af-b88a-4356-922d-936a38d1edd1 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:30.949342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505530-76af-4239-b45a-471f1c163e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:30.953630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505530-76af-4239-b45a-471f1c163e8a admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:30.953877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505530-76af-4239-b45a-471f1c163e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:30.954175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f505530-76af-4239-b45a-471f1c163e8a admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:30.955109 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f505530-76af-4239-b45a-471f1c163e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:30.960038 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f505530-76af-4239-b45a-471f1c163e8a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:31.005060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 994/1968] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:30 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:31.008971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0616b-b820-40af-96d1-257ad7832f86 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:31.022234 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0616b-b820-40af-96d1-257ad7832f86 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:31.027914 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8a52-be4e-4f69-b8d2-7ecd41993f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:31.029034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8a52-be4e-4f69-b8d2-7ecd41993f2f admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:31.029408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8a52-be4e-4f69-b8d2-7ecd41993f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:31.030016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8a52-be4e-4f69-b8d2-7ecd41993f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:31.030833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8a52-be4e-4f69-b8d2-7ecd41993f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:31.032748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd8a52-be4e-4f69-b8d2-7ecd41993f2f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:31.047941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 975/1969] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:31.052806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505530-76af-4239-b45a-471f1c163e8a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:31.063541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f505530-76af-4239-b45a-471f1c163e8a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:31.072484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbd2d3-8c47-4802-824c-c6adcdcf7c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:31.074633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd2d3-8c47-4802-824c-c6adcdcf7c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:31.075179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd2d3-8c47-4802-824c-c6adcdcf7c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:31.075441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd2d3-8c47-4802-824c-c6adcdcf7c72 admin admin] PATH_INFO: `/v3/projects/96435fa63a6a44d89d5f6ad64dc5db0b/users/65a0897dbca449ca8791523fb837ab23/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:31.093212 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbd2d3-8c47-4802-824c-c6adcdcf7c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96435fa63a6a44d89d5f6ad64dc5db0b, user_id=65a0897dbca449ca8791523fb837ab23, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:31.096418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbd2d3-8c47-4802-824c-c6adcdcf7c72 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:31.127001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 995/1970] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:31 2022] PUT /identity/v3/projects/96435fa63a6a44d89d5f6ad64dc5db0b/users/65a0897dbca449ca8791523fb837ab23/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:31.128479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8a52-be4e-4f69-b8d2-7ecd41993f2f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:31.145985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd8a52-be4e-4f69-b8d2-7ecd41993f2f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:31.246660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde64f3e-7fcc-477c-a8b8-1d8a23038ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:31.247420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64f3e-7fcc-477c-a8b8-1d8a23038ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:31.247713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64f3e-7fcc-477c-a8b8-1d8a23038ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:31.247993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde64f3e-7fcc-477c-a8b8-1d8a23038ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:31.248730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde64f3e-7fcc-477c-a8b8-1d8a23038ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:31.255867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde64f3e-7fcc-477c-a8b8-1d8a23038ba2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:31.268278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 976/1971] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:31.272891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbd2d3-8c47-4802-824c-c6adcdcf7c72 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:31.286776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbd2d3-8c47-4802-824c-c6adcdcf7c72 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:31.298104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059c91-da79-4cb0-8e64-adc3beb0b241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:31.299127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059c91-da79-4cb0-8e64-adc3beb0b241 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:31.299540 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059c91-da79-4cb0-8e64-adc3beb0b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:31.299913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059c91-da79-4cb0-8e64-adc3beb0b241 admin admin] PATH_INFO: `/v3/projects/96435fa63a6a44d89d5f6ad64dc5db0b/users/65a0897dbca449ca8791523fb837ab23/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:31.304244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21059c91-da79-4cb0-8e64-adc3beb0b241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96435fa63a6a44d89d5f6ad64dc5db0b, user_id=65a0897dbca449ca8791523fb837ab23, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:31.306761 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21059c91-da79-4cb0-8e64-adc3beb0b241 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:31.331501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 996/1972] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:31 2022] PUT /identity/v3/projects/96435fa63a6a44d89d5f6ad64dc5db0b/users/65a0897dbca449ca8791523fb837ab23/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:31.334840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f043-ac10-4fe3-9b23-15225766d7c5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:31.335246 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f043-ac10-4fe3-9b23-15225766d7c5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:31.335623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362f043-ac10-4fe3-9b23-15225766d7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:31.371976 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-9362f043-ac10-4fe3-9b23-15225766d7c5 None None] MFA Rules not processed for user `65a0897dbca449ca8791523fb837ab23`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:31.373332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9362f043-ac10-4fe3-9b23-15225766d7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:31.456839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 977/1973] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:31.469954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059c91-da79-4cb0-8e64-adc3beb0b241 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:31.528100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059c91-da79-4cb0-8e64-adc3beb0b241 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:31.532144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c232ad-d2eb-4af2-98f7-b549655147a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:31.532894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c232ad-d2eb-4af2-98f7-b549655147a2 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:31.533062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c232ad-d2eb-4af2-98f7-b549655147a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:31.533389 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c232ad-d2eb-4af2-98f7-b549655147a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:31.542821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c232ad-d2eb-4af2-98f7-b549655147a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:31.544350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c232ad-d2eb-4af2-98f7-b549655147a2 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:31.553627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 997/1974] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:31.870564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f043-ac10-4fe3-9b23-15225766d7c5 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:31.879403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362f043-ac10-4fe3-9b23-15225766d7c5 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:31.883960 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fedbfc-faa1-4117-9eb2-2bbc35d32225 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a0897dbca449ca8791523fb837ab23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96435fa63a6a44d89d5f6ad64dc5db0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:31.884621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fedbfc-faa1-4117-9eb2-2bbc35d32225 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:31.884907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fedbfc-faa1-4117-9eb2-2bbc35d32225 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:31.885213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fedbfc-faa1-4117-9eb2-2bbc35d32225 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:31.885976 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fedbfc-faa1-4117-9eb2-2bbc35d32225 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:31.886310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fedbfc-faa1-4117-9eb2-2bbc35d32225 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:31.887917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fedbfc-faa1-4117-9eb2-2bbc35d32225 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:31.899760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 978/1975] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:31.904012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c232ad-d2eb-4af2-98f7-b549655147a2 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:31.913518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c232ad-d2eb-4af2-98f7-b549655147a2 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:31.918060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e4c8d-dd24-4184-9c08-4bed0a3bf9fd tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a0897dbca449ca8791523fb837ab23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96435fa63a6a44d89d5f6ad64dc5db0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:31.918738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e4c8d-dd24-4184-9c08-4bed0a3bf9fd tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:31.919020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e4c8d-dd24-4184-9c08-4bed0a3bf9fd tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:31.919292 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e4c8d-dd24-4184-9c08-4bed0a3bf9fd tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:31.919980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e4c8d-dd24-4184-9c08-4bed0a3bf9fd tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:31.921837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e4c8d-dd24-4184-9c08-4bed0a3bf9fd tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:31.947240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 998/1976] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:31 2022] POST /identity/v3/projects => generated 352 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:31.951549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fedbfc-faa1-4117-9eb2-2bbc35d32225 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:31.961979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fedbfc-faa1-4117-9eb2-2bbc35d32225 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:32.016928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a0897dbca449ca8791523fb837ab23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96435fa63a6a44d89d5f6ad64dc5db0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:32.017481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:32.017763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:32.018035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:32.018785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:32.019088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:32.020703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:32.031878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 979/1977] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:32.068489 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e4c8d-dd24-4184-9c08-4bed0a3bf9fd tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:32.078403 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e4c8d-dd24-4184-9c08-4bed0a3bf9fd tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:32.082830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65a0897dbca449ca8791523fb837ab23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96435fa63a6a44d89d5f6ad64dc5db0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:32.083676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:32.083956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:32.084262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] PATH_INFO: `/v3/projects/2b66cc2f29ec4e5d9b9317202e2512cc` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:32.085409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2b66cc2f29ec4e5d9b9317202e2512cc)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:32.087313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:32.131695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b66cc2f29ec4e5d9b9317202e2512cc', 'request_id': 'req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.138074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b66cc2f29ec4e5d9b9317202e2512cc', 'request_id': 'req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.144357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b66cc2f29ec4e5d9b9317202e2512cc', 'request_id': 'req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.156414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] The token cache is being invalidate because project 2b66cc2f29ec4e5d9b9317202e2512cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:32.156909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.157776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fe21929d-fd06-4c35-864e-3cd9f3ada9e0 tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.159587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 999/1978] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:32 2022] DELETE /identity/v3/projects/2b66cc2f29ec4e5d9b9317202e2512cc => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:32.603367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:32.606004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:32.718614 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2141856-c4bc-4b9e-87f4-136ffe6ff3ed tempest-VolumeQuotaClassesTest-1810445663 tempest-VolumeQuotaClassesTest-1810445663-project-admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:32.788827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:32.789713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:32.790000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:32.790299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] PATH_INFO: `/v3/users/41b9f23a0c904d2dae33c3c7f03535a3` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:32.791507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b9f23a0c904d2dae33c3c7f03535a3)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:32.793475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:32.846238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b9f23a0c904d2dae33c3c7f03535a3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.853739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b9f23a0c904d2dae33c3c7f03535a3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.863547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b9f23a0c904d2dae33c3c7f03535a3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.864174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b9f23a0c904d2dae33c3c7f03535a3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.865459 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b9f23a0c904d2dae33c3c7f03535a3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:32.883357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 980/1979] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:32 2022] DELETE /identity/v3/users/41b9f23a0c904d2dae33c3c7f03535a3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:32.887975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f19e-9e20-4ff5-b7e4-a6723eac3f95 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:32.888330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f19e-9e20-4ff5-b7e4-a6723eac3f95 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:32.888569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f19e-9e20-4ff5-b7e4-a6723eac3f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:32.907455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-fb68f19e-9e20-4ff5-b7e4-a6723eac3f95 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:32.908700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fb68f19e-9e20-4ff5-b7e4-a6723eac3f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:32.978871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1000/1980] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:32.988495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:32.990340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:33.074797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90281e3-9f6e-4686-9cfa-4cdad82de8db admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:33.079566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e59ac-ca48-4367-9e97-2fc2f52916dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:33.080541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e59ac-ca48-4367-9e97-2fc2f52916dd service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:33.081318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e59ac-ca48-4367-9e97-2fc2f52916dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:33.081808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e59ac-ca48-4367-9e97-2fc2f52916dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:33.103144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e59ac-ca48-4367-9e97-2fc2f52916dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:33.104783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e59ac-ca48-4367-9e97-2fc2f52916dd service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:33.115939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 981/1981] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:33.392343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f19e-9e20-4ff5-b7e4-a6723eac3f95 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:33.394039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fb68f19e-9e20-4ff5-b7e4-a6723eac3f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:33.409433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f19e-9e20-4ff5-b7e4-a6723eac3f95 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:33.416539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:33.417503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:33.417864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:33.418220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] PATH_INFO: `/v3/projects/04633abbfc244dae9c112c54d038c561` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:33.419646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04633abbfc244dae9c112c54d038c561)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:33.421778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:33.484639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04633abbfc244dae9c112c54d038c561', 'request_id': 'req-647890b7-56de-46ac-95ea-3bc7e9f03fa5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.494003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04633abbfc244dae9c112c54d038c561', 'request_id': 'req-647890b7-56de-46ac-95ea-3bc7e9f03fa5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.501851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04633abbfc244dae9c112c54d038c561', 'request_id': 'req-647890b7-56de-46ac-95ea-3bc7e9f03fa5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.514144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] The token cache is being invalidate because project 04633abbfc244dae9c112c54d038c561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:33.514660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.515438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.517269 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1001/1982] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:33 2022] DELETE /identity/v3/projects/04633abbfc244dae9c112c54d038c561 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:33.521940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e59ac-ca48-4367-9e97-2fc2f52916dd service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:33.531970 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e59ac-ca48-4367-9e97-2fc2f52916dd service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:33.641413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:33.642356 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:33.642639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:33.643048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] PATH_INFO: `/v3/users/65a0897dbca449ca8791523fb837ab23` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:33.644448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a0897dbca449ca8791523fb837ab23)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:33.647143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:33.759734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a0897dbca449ca8791523fb837ab23'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.776791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a0897dbca449ca8791523fb837ab23'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.786866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a0897dbca449ca8791523fb837ab23'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.787807 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a0897dbca449ca8791523fb837ab23'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.788688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-31f2dfc1-5a16-45d5-9286-1cb26b8d4949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a0897dbca449ca8791523fb837ab23'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.815389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 982/1983] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:33 2022] DELETE /identity/v3/users/65a0897dbca449ca8791523fb837ab23 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:33.835157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:33.836655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:33.850374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647890b7-56de-46ac-95ea-3bc7e9f03fa5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:33.916701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:33.918640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:33.918934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:33.919215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] PATH_INFO: `/v3/users/1218301572c1427e9514a4663aa09878` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:33.920432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1218301572c1427e9514a4663aa09878)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:33.922529 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:33.977663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1218301572c1427e9514a4663aa09878'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.985659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1218301572c1427e9514a4663aa09878'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.997024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1218301572c1427e9514a4663aa09878'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.997917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1218301572c1427e9514a4663aa09878'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:33.998695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1218301572c1427e9514a4663aa09878'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.017850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1002/1984] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:33 2022] DELETE /identity/v3/users/1218301572c1427e9514a4663aa09878 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:34.024556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab00b1-b561-4a72-9e75-287fdeb881bd None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.024978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab00b1-b561-4a72-9e75-287fdeb881bd None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.025054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab00b1-b561-4a72-9e75-287fdeb881bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.043600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a6ab00b1-b561-4a72-9e75-287fdeb881bd None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:34.044809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a6ab00b1-b561-4a72-9e75-287fdeb881bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:34.110219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 983/1985] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:34.114798 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.116256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:34.129135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab00b1-b561-4a72-9e75-287fdeb881bd None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.129960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53f6d7-dd4f-4744-913b-d9ebe7cb2dcf admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:34.130745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a6ab00b1-b561-4a72-9e75-287fdeb881bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:34.157711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:34.158642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.158924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.159247 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] PATH_INFO: `/v3/projects/96435fa63a6a44d89d5f6ad64dc5db0b` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.160583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96435fa63a6a44d89d5f6ad64dc5db0b)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:34.163891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:34.213819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab00b1-b561-4a72-9e75-287fdeb881bd None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:34.241557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96435fa63a6a44d89d5f6ad64dc5db0b', 'request_id': 'req-0ba978be-e4fd-4a67-b803-6a0c9b08f495'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.255810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96435fa63a6a44d89d5f6ad64dc5db0b', 'request_id': 'req-0ba978be-e4fd-4a67-b803-6a0c9b08f495'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.264183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96435fa63a6a44d89d5f6ad64dc5db0b', 'request_id': 'req-0ba978be-e4fd-4a67-b803-6a0c9b08f495'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.283640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] The token cache is being invalidate because project 96435fa63a6a44d89d5f6ad64dc5db0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:34.283921 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.285451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0ba978be-e4fd-4a67-b803-6a0c9b08f495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.287277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1003/1986] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:34 2022] DELETE /identity/v3/projects/96435fa63a6a44d89d5f6ad64dc5db0b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:34.292377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b5cb-68da-4c89-9ef0-539e79b5fa3b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.292901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b5cb-68da-4c89-9ef0-539e79b5fa3b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.293453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87b5cb-68da-4c89-9ef0-539e79b5fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.297116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd0bac-48f5-4062-bc35-e0e9ccfd530c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:34.297967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0bac-48f5-4062-bc35-e0e9ccfd530c service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.298710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0bac-48f5-4062-bc35-e0e9ccfd530c service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.299178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0bac-48f5-4062-bc35-e0e9ccfd530c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.302580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-aefd0bac-48f5-4062-bc35-e0e9ccfd530c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:34.333568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3c87b5cb-68da-4c89-9ef0-539e79b5fa3b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:34.334129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3c87b5cb-68da-4c89-9ef0-539e79b5fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:34.427124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd0bac-48f5-4062-bc35-e0e9ccfd530c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:34.428803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd0bac-48f5-4062-bc35-e0e9ccfd530c service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:34.436979 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1004/1987] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:34.444629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fb093-0a02-4105-b017-9631f1f6fde4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.444930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fb093-0a02-4105-b017-9631f1f6fde4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.445211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fb093-0a02-4105-b017-9631f1f6fde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.446472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 984/1988] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:34.477250 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f24fb093-0a02-4105-b017-9631f1f6fde4 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:34.479114 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f24fb093-0a02-4105-b017-9631f1f6fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:34.491003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1005/1989] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:34.495172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd0bac-48f5-4062-bc35-e0e9ccfd530c service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.507566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd0bac-48f5-4062-bc35-e0e9ccfd530c service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:34.514831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032ff62-dadb-42b0-819e-1b80e6b90e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:34.515681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ff62-dadb-42b0-819e-1b80e6b90e59 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.516062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ff62-dadb-42b0-819e-1b80e6b90e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.516438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032ff62-dadb-42b0-819e-1b80e6b90e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.517298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032ff62-dadb-42b0-819e-1b80e6b90e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:34.517710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032ff62-dadb-42b0-819e-1b80e6b90e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:34.519925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032ff62-dadb-42b0-819e-1b80e6b90e59 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:34.535062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 985/1990] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:34.540339 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fb093-0a02-4105-b017-9631f1f6fde4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.557601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fb093-0a02-4105-b017-9631f1f6fde4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:34.563380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065c93d-b46c-4506-9666-8045058b8181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:34.564063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c93d-b46c-4506-9666-8045058b8181 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.564399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c93d-b46c-4506-9666-8045058b8181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.564681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c93d-b46c-4506-9666-8045058b8181 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.565433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065c93d-b46c-4506-9666-8045058b8181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:34.567520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065c93d-b46c-4506-9666-8045058b8181 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:34.607242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1006/1991] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:34 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:34.608648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032ff62-dadb-42b0-819e-1b80e6b90e59 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.630671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032ff62-dadb-42b0-819e-1b80e6b90e59 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:34.718347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a64604-9307-4280-86b2-667b308ff6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:34.719110 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a64604-9307-4280-86b2-667b308ff6dc admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.721314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a64604-9307-4280-86b2-667b308ff6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.721314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a64604-9307-4280-86b2-667b308ff6dc admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.722146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a64604-9307-4280-86b2-667b308ff6dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:34.727572 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a64604-9307-4280-86b2-667b308ff6dc admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:34.758551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065c93d-b46c-4506-9666-8045058b8181 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.760501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1065c93d-b46c-4506-9666-8045058b8181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:34.775318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065c93d-b46c-4506-9666-8045058b8181 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:34.777754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 986/1992] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:34 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:34.781965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a64604-9307-4280-86b2-667b308ff6dc admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.783672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:34.784795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.785083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.787931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] PATH_INFO: `/v3/projects/e3ed4ed4ec8f46369d9f49ae8b6293d9` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.789251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ed4ed4ec8f46369d9f49ae8b6293d9)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:34.791216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:34.805631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a64604-9307-4280-86b2-667b308ff6dc admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:34.813931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c3e8-3cd4-4ca0-af9d-df15f1adc60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:34.814656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c3e8-3cd4-4ca0-af9d-df15f1adc60e admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.814938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c3e8-3cd4-4ca0-af9d-df15f1adc60e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.815208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8c3e8-3cd4-4ca0-af9d-df15f1adc60e admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.816717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8c3e8-3cd4-4ca0-af9d-df15f1adc60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:34.818575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8c3e8-3cd4-4ca0-af9d-df15f1adc60e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:34.834296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 987/1993] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:34.835316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c3e8-3cd4-4ca0-af9d-df15f1adc60e admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.846077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8c3e8-3cd4-4ca0-af9d-df15f1adc60e admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:34.861878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875f5a-ef45-438b-a7fc-db161ccc6945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:34.862835 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ed4ed4ec8f46369d9f49ae8b6293d9', 'request_id': 'req-7db05a2e-248d-4662-8be8-1c255bd18bc5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.862982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875f5a-ef45-438b-a7fc-db161ccc6945 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.863139 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875f5a-ef45-438b-a7fc-db161ccc6945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.863965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44875f5a-ef45-438b-a7fc-db161ccc6945 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:34.864707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44875f5a-ef45-438b-a7fc-db161ccc6945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:34.866364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44875f5a-ef45-438b-a7fc-db161ccc6945 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:34.881479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 988/1994] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:34.882811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ed4ed4ec8f46369d9f49ae8b6293d9', 'request_id': 'req-7db05a2e-248d-4662-8be8-1c255bd18bc5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.886488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875f5a-ef45-438b-a7fc-db161ccc6945 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.895395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ed4ed4ec8f46369d9f49ae8b6293d9', 'request_id': 'req-7db05a2e-248d-4662-8be8-1c255bd18bc5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.900483 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44875f5a-ef45-438b-a7fc-db161ccc6945 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:34.925559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] The token cache is being invalidate because project e3ed4ed4ec8f46369d9f49ae8b6293d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:34.927013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.927936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:34.929711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1007/1995] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:34 2022] DELETE /identity/v3/projects/e3ed4ed4ec8f46369d9f49ae8b6293d9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:34.935507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:34.937388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:34.977669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a1f48-92eb-4de4-ae71-05f403e54f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:34.979481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1f48-92eb-4de4-ae71-05f403e54f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:34.979768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1f48-92eb-4de4-ae71-05f403e54f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:34.980252 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a1f48-92eb-4de4-ae71-05f403e54f7e admin admin] PATH_INFO: `/v3/projects/0f759bc9c549400cb10e8b7e62880e4f/users/28e9dbefea434acf980577c4f0715180/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.006273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a1f48-92eb-4de4-ae71-05f403e54f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f759bc9c549400cb10e8b7e62880e4f, user_id=28e9dbefea434acf980577c4f0715180, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.008962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a1f48-92eb-4de4-ae71-05f403e54f7e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.022333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05a2e-248d-4662-8be8-1c255bd18bc5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.025227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 989/1996] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:34 2022] PUT /identity/v3/projects/0f759bc9c549400cb10e8b7e62880e4f/users/28e9dbefea434acf980577c4f0715180/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:35.035931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd8fa5-39a0-4eed-b329-bf485cd16c34 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.036306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd8fa5-39a0-4eed-b329-bf485cd16c34 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.036679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd8fa5-39a0-4eed-b329-bf485cd16c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.066200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-73fd8fa5-39a0-4eed-b329-bf485cd16c34 None None] MFA Rules not processed for user `28e9dbefea434acf980577c4f0715180`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:35.068325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-73fd8fa5-39a0-4eed-b329-bf485cd16c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:35.094220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.095236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.095615 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.095988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] PATH_INFO: `/v3/users/2c88e08968734ba5a18237bb9e3497f7` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.097277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c88e08968734ba5a18237bb9e3497f7)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.099888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.136812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 990/1997] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:35.140979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd8fa5-39a0-4eed-b329-bf485cd16c34 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.142367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-73fd8fa5-39a0-4eed-b329-bf485cd16c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:35.151268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c88e08968734ba5a18237bb9e3497f7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.155547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd8fa5-39a0-4eed-b329-bf485cd16c34 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.158554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c88e08968734ba5a18237bb9e3497f7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.161344 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8272896-973c-441a-90da-bcd6a76e9668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.162001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8272896-973c-441a-90da-bcd6a76e9668 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.162312 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8272896-973c-441a-90da-bcd6a76e9668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.162597 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8272896-973c-441a-90da-bcd6a76e9668 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.164146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8272896-973c-441a-90da-bcd6a76e9668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.165205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8272896-973c-441a-90da-bcd6a76e9668 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.168319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c88e08968734ba5a18237bb9e3497f7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.169833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c88e08968734ba5a18237bb9e3497f7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.170496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c88e08968734ba5a18237bb9e3497f7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.192249 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1008/1998] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:34 2022] DELETE /identity/v3/users/2c88e08968734ba5a18237bb9e3497f7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:35.195587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 991/1999] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:35 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:35.196229 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.197601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:35.270429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126706c-c89a-4189-8785-ba3884b46016 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.275252 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f3644-bf87-4c60-97b3-c4dc53e18a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.276187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f3644-bf87-4c60-97b3-c4dc53e18a47 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.276465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f3644-bf87-4c60-97b3-c4dc53e18a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.276739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f3644-bf87-4c60-97b3-c4dc53e18a47 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.277428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f3644-bf87-4c60-97b3-c4dc53e18a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.279477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f3644-bf87-4c60-97b3-c4dc53e18a47 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.300940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1009/2000] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:35 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:35.305163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8272896-973c-441a-90da-bcd6a76e9668 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.386642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8272896-973c-441a-90da-bcd6a76e9668 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.392522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d4bf4-214f-426c-ac2b-0c5fc7ef8003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.393209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d4bf4-214f-426c-ac2b-0c5fc7ef8003 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.393567 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d4bf4-214f-426c-ac2b-0c5fc7ef8003 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.393880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d4bf4-214f-426c-ac2b-0c5fc7ef8003 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.395708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d4bf4-214f-426c-ac2b-0c5fc7ef8003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.397368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d4bf4-214f-426c-ac2b-0c5fc7ef8003 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.408862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 992/2001] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:35.412977 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f3644-bf87-4c60-97b3-c4dc53e18a47 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.424694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f3644-bf87-4c60-97b3-c4dc53e18a47 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.431121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15425311-c0da-40a2-b977-7ba278012a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.432022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15425311-c0da-40a2-b977-7ba278012a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.432308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15425311-c0da-40a2-b977-7ba278012a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.432588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15425311-c0da-40a2-b977-7ba278012a40 admin admin] PATH_INFO: `/v3/projects/d06c2473c6e64d05a6615ce732da0db8/users/5a7ddf26fdb84b9b855bbfb8b31af8a8/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.455120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15425311-c0da-40a2-b977-7ba278012a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06c2473c6e64d05a6615ce732da0db8, user_id=5a7ddf26fdb84b9b855bbfb8b31af8a8, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.459391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15425311-c0da-40a2-b977-7ba278012a40 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.473476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1010/2002] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:35 2022] PUT /identity/v3/projects/d06c2473c6e64d05a6615ce732da0db8/users/5a7ddf26fdb84b9b855bbfb8b31af8a8/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:35.477505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d4bf4-214f-426c-ac2b-0c5fc7ef8003 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.487340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d4bf4-214f-426c-ac2b-0c5fc7ef8003 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.506853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15425311-c0da-40a2-b977-7ba278012a40 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.508754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-15425311-c0da-40a2-b977-7ba278012a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:35.569648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526881d6-47bf-452f-b52f-41337fa9f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.571161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526881d6-47bf-452f-b52f-41337fa9f821 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.571453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526881d6-47bf-452f-b52f-41337fa9f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.571735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526881d6-47bf-452f-b52f-41337fa9f821 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.572473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526881d6-47bf-452f-b52f-41337fa9f821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.574102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526881d6-47bf-452f-b52f-41337fa9f821 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.576974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15425311-c0da-40a2-b977-7ba278012a40 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.583988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.584856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.585134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.585406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] PATH_INFO: `/v3/projects/9ad9baa1d7d24cc9bf6fc385fc6f08f1` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.586092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 993/2003] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:35.589743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad9baa1d7d24cc9bf6fc385fc6f08f1)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.590201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526881d6-47bf-452f-b52f-41337fa9f821 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.591774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.600619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526881d6-47bf-452f-b52f-41337fa9f821 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.605861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721c8f9-81b7-4199-b821-fa1f5d153b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.607003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c8f9-81b7-4199-b821-fa1f5d153b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.607318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c8f9-81b7-4199-b821-fa1f5d153b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.607689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721c8f9-81b7-4199-b821-fa1f5d153b46 admin admin] PATH_INFO: `/v3/projects/d06c2473c6e64d05a6615ce732da0db8/users/5a7ddf26fdb84b9b855bbfb8b31af8a8/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.609776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721c8f9-81b7-4199-b821-fa1f5d153b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06c2473c6e64d05a6615ce732da0db8, user_id=5a7ddf26fdb84b9b855bbfb8b31af8a8, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.612573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721c8f9-81b7-4199-b821-fa1f5d153b46 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.630398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 994/2004] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:35 2022] PUT /identity/v3/projects/d06c2473c6e64d05a6615ce732da0db8/users/5a7ddf26fdb84b9b855bbfb8b31af8a8/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:35.644184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540501b-261d-46b0-a87f-cab403301e6d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.645146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540501b-261d-46b0-a87f-cab403301e6d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.645878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540501b-261d-46b0-a87f-cab403301e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.667028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad9baa1d7d24cc9bf6fc385fc6f08f1', 'request_id': 'req-15b7c185-e16f-439b-91fe-2166e548967d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.675077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad9baa1d7d24cc9bf6fc385fc6f08f1', 'request_id': 'req-15b7c185-e16f-439b-91fe-2166e548967d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.683013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad9baa1d7d24cc9bf6fc385fc6f08f1', 'request_id': 'req-15b7c185-e16f-439b-91fe-2166e548967d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.685917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b540501b-261d-46b0-a87f-cab403301e6d None None] MFA Rules not processed for user `5a7ddf26fdb84b9b855bbfb8b31af8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:35.687161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b540501b-261d-46b0-a87f-cab403301e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:35.694534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] The token cache is being invalidate because project 9ad9baa1d7d24cc9bf6fc385fc6f08f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:35.695298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.695606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.697186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1011/2005] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:35 2022] DELETE /identity/v3/projects/9ad9baa1d7d24cc9bf6fc385fc6f08f1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:35.701115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.702769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:35.764106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 995/2006] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:35.771223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c185-e16f-439b-91fe-2166e548967d admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.776675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.777650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.778032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.778443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] PATH_INFO: `/v3/users/00f5e6ff211545b292af9098011c41d3` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.779751 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f5e6ff211545b292af9098011c41d3)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.779989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540501b-261d-46b0-a87f-cab403301e6d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.782000 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.782572 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b540501b-261d-46b0-a87f-cab403301e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:35.844913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f5e6ff211545b292af9098011c41d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.852529 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f5e6ff211545b292af9098011c41d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.856890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540501b-261d-46b0-a87f-cab403301e6d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:35.861513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:35.861643 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f5e6ff211545b292af9098011c41d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.862411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f5e6ff211545b292af9098011c41d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.862523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:35.862703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:35.863121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f5e6ff211545b292af9098011c41d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:35.863214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:35.865107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:35.878024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:35.880420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:35.890688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 996/2007] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:35.891700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1012/2008] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:35 2022] DELETE /identity/v3/users/00f5e6ff211545b292af9098011c41d3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:35.938106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:35.939810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:35.950948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2a980-987e-4400-9bc0-fda5eaf9354c service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:36.003756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f47b70-8fd1-4baa-b0a6-cfaa5ff38db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:36.004652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f47b70-8fd1-4baa-b0a6-cfaa5ff38db1 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.005036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f47b70-8fd1-4baa-b0a6-cfaa5ff38db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.005446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f47b70-8fd1-4baa-b0a6-cfaa5ff38db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.007725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e0f47b70-8fd1-4baa-b0a6-cfaa5ff38db1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:36.070178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f47b70-8fd1-4baa-b0a6-cfaa5ff38db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:36.071887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f47b70-8fd1-4baa-b0a6-cfaa5ff38db1 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:36.083177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 997/2009] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:36.319989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:36.322205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:36.399731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaef951-d593-46c2-9c6d-c3665fbef5e6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:36.404565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:36.405430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.405713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.406021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] PATH_INFO: `/v3/projects/47fb8708cedd4369a37af64b2f1765ee` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.407236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47fb8708cedd4369a37af64b2f1765ee)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:36.409142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:36.460076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47fb8708cedd4369a37af64b2f1765ee', 'request_id': 'req-f21ad4db-1c8e-4fff-9915-b664205642d4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:36.467067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47fb8708cedd4369a37af64b2f1765ee', 'request_id': 'req-f21ad4db-1c8e-4fff-9915-b664205642d4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:36.474009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47fb8708cedd4369a37af64b2f1765ee', 'request_id': 'req-f21ad4db-1c8e-4fff-9915-b664205642d4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:36.484017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] The token cache is being invalidate because project 47fb8708cedd4369a37af64b2f1765ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:36.484304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:36.484961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f21ad4db-1c8e-4fff-9915-b664205642d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:36.486654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1013/2010] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:36 2022] DELETE /identity/v3/projects/47fb8708cedd4369a37af64b2f1765ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:36.492958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52c513-beff-41d6-9e94-088f6d8ddb94 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.493255 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52c513-beff-41d6-9e94-088f6d8ddb94 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.493540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52c513-beff-41d6-9e94-088f6d8ddb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.511177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0f52c513-beff-41d6-9e94-088f6d8ddb94 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:36.512365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0f52c513-beff-41d6-9e94-088f6d8ddb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:36.574733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 998/2011] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:36.584280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490639f5-130f-4b22-9f22-ef7b3148cb6b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.584576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490639f5-130f-4b22-9f22-ef7b3148cb6b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.584856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490639f5-130f-4b22-9f22-ef7b3148cb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.603041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-490639f5-130f-4b22-9f22-ef7b3148cb6b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:36.604226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-490639f5-130f-4b22-9f22-ef7b3148cb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:36.611911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1014/2012] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:36.617507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52c513-beff-41d6-9e94-088f6d8ddb94 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:36.627485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52c513-beff-41d6-9e94-088f6d8ddb94 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:36.632043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fdfda-0115-4d29-a0ff-8f69abf2df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:36.632699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fdfda-0115-4d29-a0ff-8f69abf2df63 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.632981 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fdfda-0115-4d29-a0ff-8f69abf2df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.633258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fdfda-0115-4d29-a0ff-8f69abf2df63 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.633979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fdfda-0115-4d29-a0ff-8f69abf2df63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:36.634313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fdfda-0115-4d29-a0ff-8f69abf2df63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:36.635905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fdfda-0115-4d29-a0ff-8f69abf2df63 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:36.646859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 999/2013] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:36.651467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490639f5-130f-4b22-9f22-ef7b3148cb6b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:36.660985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490639f5-130f-4b22-9f22-ef7b3148cb6b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:36.665595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42904f7b-9754-4415-9a49-f0ce17dddab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:36.666311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42904f7b-9754-4415-9a49-f0ce17dddab6 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.666563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42904f7b-9754-4415-9a49-f0ce17dddab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.666857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42904f7b-9754-4415-9a49-f0ce17dddab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.667596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42904f7b-9754-4415-9a49-f0ce17dddab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:36.669987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42904f7b-9754-4415-9a49-f0ce17dddab6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:36.696160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1015/2014] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:36 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:36.700227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fdfda-0115-4d29-a0ff-8f69abf2df63 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:36.709938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fdfda-0115-4d29-a0ff-8f69abf2df63 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:36.768734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e6c3-b70f-4abe-8e1a-6b36f1716878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:36.769408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e6c3-b70f-4abe-8e1a-6b36f1716878 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.769723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e6c3-b70f-4abe-8e1a-6b36f1716878 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.770001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e6c3-b70f-4abe-8e1a-6b36f1716878 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.770727 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e6c3-b70f-4abe-8e1a-6b36f1716878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:36.772670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58e6c3-b70f-4abe-8e1a-6b36f1716878 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:36.795439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1000/2015] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:36 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:36.801668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42904f7b-9754-4415-9a49-f0ce17dddab6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:36.818050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42904f7b-9754-4415-9a49-f0ce17dddab6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:36.822661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d7bc1-1c50-46e1-8057-3e93569c8bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:36.823349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d7bc1-1c50-46e1-8057-3e93569c8bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.823630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d7bc1-1c50-46e1-8057-3e93569c8bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.823900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d7bc1-1c50-46e1-8057-3e93569c8bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.824616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d7bc1-1c50-46e1-8057-3e93569c8bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:36.826205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d7bc1-1c50-46e1-8057-3e93569c8bc6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:36.836585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1016/2016] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:36.840485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e6c3-b70f-4abe-8e1a-6b36f1716878 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:36.850859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e6c3-b70f-4abe-8e1a-6b36f1716878 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:36.857667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd3b09-33fb-4b48-a621-4bfc843a68ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:36.859015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd3b09-33fb-4b48-a621-4bfc843a68ab admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.859302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd3b09-33fb-4b48-a621-4bfc843a68ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.859578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd3b09-33fb-4b48-a621-4bfc843a68ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.860410 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd3b09-33fb-4b48-a621-4bfc843a68ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:36.861991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd3b09-33fb-4b48-a621-4bfc843a68ab admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:36.874320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1001/2017] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:36.876582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d7bc1-1c50-46e1-8057-3e93569c8bc6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:36.887175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d7bc1-1c50-46e1-8057-3e93569c8bc6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:36.892142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078656e0-0f27-4933-8a9c-4163e8f2fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:36.893062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078656e0-0f27-4933-8a9c-4163e8f2fb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.893519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078656e0-0f27-4933-8a9c-4163e8f2fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.893714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078656e0-0f27-4933-8a9c-4163e8f2fb87 admin admin] PATH_INFO: `/v3/projects/64fb0b4f9ef0493dac9c225a96e2d62f/users/6a41632790954ef7bd30afa4f81321cb/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.908897 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078656e0-0f27-4933-8a9c-4163e8f2fb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64fb0b4f9ef0493dac9c225a96e2d62f, user_id=6a41632790954ef7bd30afa4f81321cb, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:36.912062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078656e0-0f27-4933-8a9c-4163e8f2fb87 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:36.924313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1017/2018] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:36 2022] PUT /identity/v3/projects/64fb0b4f9ef0493dac9c225a96e2d62f/users/6a41632790954ef7bd30afa4f81321cb/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:36.935515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b10c8c-1985-48c0-8433-abeeaa2a125f None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:36.935804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b10c8c-1985-48c0-8433-abeeaa2a125f None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:36.936079 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b10c8c-1985-48c0-8433-abeeaa2a125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:36.963096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d5b10c8c-1985-48c0-8433-abeeaa2a125f None None] MFA Rules not processed for user `6a41632790954ef7bd30afa4f81321cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:36.964230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d5b10c8c-1985-48c0-8433-abeeaa2a125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:37.024423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1002/2019] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:37.029159 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078656e0-0f27-4933-8a9c-4163e8f2fb87 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:37.088648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078656e0-0f27-4933-8a9c-4163e8f2fb87 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:37.093208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839584a-5b62-4ec2-89f6-fa5ebfd12618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:37.093853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839584a-5b62-4ec2-89f6-fa5ebfd12618 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:37.094135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839584a-5b62-4ec2-89f6-fa5ebfd12618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:37.094514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839584a-5b62-4ec2-89f6-fa5ebfd12618 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:37.095187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839584a-5b62-4ec2-89f6-fa5ebfd12618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:37.097059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839584a-5b62-4ec2-89f6-fa5ebfd12618 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:37.120764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1018/2020] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:37 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:37.124867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b10c8c-1985-48c0-8433-abeeaa2a125f None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:37.135108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b10c8c-1985-48c0-8433-abeeaa2a125f None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:37.190204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cb7aa-f4a8-4ed5-883d-9a86a3bd8110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:37.190905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cb7aa-f4a8-4ed5-883d-9a86a3bd8110 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:37.191189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cb7aa-f4a8-4ed5-883d-9a86a3bd8110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:37.191501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cb7aa-f4a8-4ed5-883d-9a86a3bd8110 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:37.192186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cb7aa-f4a8-4ed5-883d-9a86a3bd8110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:37.194084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301cb7aa-f4a8-4ed5-883d-9a86a3bd8110 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:37.213758 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1003/2021] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:37 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:37.217666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839584a-5b62-4ec2-89f6-fa5ebfd12618 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:37.228338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839584a-5b62-4ec2-89f6-fa5ebfd12618 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:37.233007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4795bde-6141-4757-9f81-fb7c22991b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:37.233667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4795bde-6141-4757-9f81-fb7c22991b42 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:37.233946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4795bde-6141-4757-9f81-fb7c22991b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:37.234219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4795bde-6141-4757-9f81-fb7c22991b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:37.234974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4795bde-6141-4757-9f81-fb7c22991b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:37.236539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4795bde-6141-4757-9f81-fb7c22991b42 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:37.247628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1019/2022] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:37.251849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cb7aa-f4a8-4ed5-883d-9a86a3bd8110 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:37.262230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cb7aa-f4a8-4ed5-883d-9a86a3bd8110 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:37.267640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35e65-2071-4c10-bb82-37729b9b93ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:37.268562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35e65-2071-4c10-bb82-37729b9b93ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:37.268857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35e65-2071-4c10-bb82-37729b9b93ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:37.269149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e35e65-2071-4c10-bb82-37729b9b93ff admin admin] PATH_INFO: `/v3/projects/146dab4945954272aafe58868c77ca89/users/1bd26bc11df74d2db78106601d783824/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:37.284554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35e65-2071-4c10-bb82-37729b9b93ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=146dab4945954272aafe58868c77ca89, user_id=1bd26bc11df74d2db78106601d783824, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:37.287290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e35e65-2071-4c10-bb82-37729b9b93ff admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:37.301414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1004/2023] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:37 2022] PUT /identity/v3/projects/146dab4945954272aafe58868c77ca89/users/1bd26bc11df74d2db78106601d783824/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:37.305586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4795bde-6141-4757-9f81-fb7c22991b42 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:37.315471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4795bde-6141-4757-9f81-fb7c22991b42 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:37.372082 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd2e79-8ac4-4b8e-888c-5ba5de7d4f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:37.372786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd2e79-8ac4-4b8e-888c-5ba5de7d4f55 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:37.373068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd2e79-8ac4-4b8e-888c-5ba5de7d4f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:37.373344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd2e79-8ac4-4b8e-888c-5ba5de7d4f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:37.374076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd2e79-8ac4-4b8e-888c-5ba5de7d4f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:37.375737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd2e79-8ac4-4b8e-888c-5ba5de7d4f55 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:37.387610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1020/2024] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:37.392539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35e65-2071-4c10-bb82-37729b9b93ff admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:37.405215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e35e65-2071-4c10-bb82-37729b9b93ff admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:37.411197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68344518-7b11-4d14-8341-16cc29b561e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:37.412960 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68344518-7b11-4d14-8341-16cc29b561e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:37.413195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68344518-7b11-4d14-8341-16cc29b561e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:37.413914 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68344518-7b11-4d14-8341-16cc29b561e8 admin admin] PATH_INFO: `/v3/projects/146dab4945954272aafe58868c77ca89/users/1bd26bc11df74d2db78106601d783824/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:37.415795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68344518-7b11-4d14-8341-16cc29b561e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=146dab4945954272aafe58868c77ca89, user_id=1bd26bc11df74d2db78106601d783824, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:37.418403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68344518-7b11-4d14-8341-16cc29b561e8 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:37.430281 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1005/2025] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:37 2022] PUT /identity/v3/projects/146dab4945954272aafe58868c77ca89/users/1bd26bc11df74d2db78106601d783824/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:37.442031 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5e91-f55f-476f-a999-91dd4b440c57 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:37.442396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5e91-f55f-476f-a999-91dd4b440c57 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:37.442686 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc5e91-f55f-476f-a999-91dd4b440c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:37.468796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2ecc5e91-f55f-476f-a999-91dd4b440c57 None None] MFA Rules not processed for user `1bd26bc11df74d2db78106601d783824`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:37.469932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2ecc5e91-f55f-476f-a999-91dd4b440c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:37.536423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1021/2026] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:37.547544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68344518-7b11-4d14-8341-16cc29b561e8 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:37.549309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-68344518-7b11-4d14-8341-16cc29b561e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:37.603456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68344518-7b11-4d14-8341-16cc29b561e8 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:37.607067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0134a61-bffc-41e7-b5e1-d89915f3cd1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:37.607731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134a61-bffc-41e7-b5e1-d89915f3cd1f service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:37.608045 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134a61-bffc-41e7-b5e1-d89915f3cd1f service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:37.608330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0134a61-bffc-41e7-b5e1-d89915f3cd1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:37.662511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0134a61-bffc-41e7-b5e1-d89915f3cd1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:37.663947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0134a61-bffc-41e7-b5e1-d89915f3cd1f service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:37.672821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1006/2027] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:41.267061 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc5e91-f55f-476f-a999-91dd4b440c57 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:41.328314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc5e91-f55f-476f-a999-91dd4b440c57 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:41.332752 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:41.333600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:41.333879 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:41.334150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] PATH_INFO: `/v3/users/6a41632790954ef7bd30afa4f81321cb` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:41.335388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a41632790954ef7bd30afa4f81321cb)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:41.337281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:41.385221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a41632790954ef7bd30afa4f81321cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.392857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a41632790954ef7bd30afa4f81321cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.401378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a41632790954ef7bd30afa4f81321cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.402118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a41632790954ef7bd30afa4f81321cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.402813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a41632790954ef7bd30afa4f81321cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.419455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1022/2028] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:41 2022] DELETE /identity/v3/users/6a41632790954ef7bd30afa4f81321cb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:41.423899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f483-9346-43b1-893f-326c33609862 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:41.424370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f483-9346-43b1-893f-326c33609862 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:41.424644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a12f483-9346-43b1-893f-326c33609862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:41.441689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0a12f483-9346-43b1-893f-326c33609862 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:41.442962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0a12f483-9346-43b1-893f-326c33609862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:41.501537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1007/2029] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:41.511476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:41.512988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:41.529385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f483-9346-43b1-893f-326c33609862 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:41.530821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0a12f483-9346-43b1-893f-326c33609862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:41.543733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a12f483-9346-43b1-893f-326c33609862 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:41.548361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:41.549233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:41.549517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:41.549792 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] PATH_INFO: `/v3/users/28e9dbefea434acf980577c4f0715180` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:41.551540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e9dbefea434acf980577c4f0715180)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:41.553470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:41.574954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2264f1-34a3-496c-a8de-027abb929783 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:41.578882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224785a3-99ab-4564-bf17-dcea6107a6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:41.579534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224785a3-99ab-4564-bf17-dcea6107a6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:41.579847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224785a3-99ab-4564-bf17-dcea6107a6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:41.580091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224785a3-99ab-4564-bf17-dcea6107a6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:41.590823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224785a3-99ab-4564-bf17-dcea6107a6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:41.592529 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224785a3-99ab-4564-bf17-dcea6107a6c8 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:41.603060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e9dbefea434acf980577c4f0715180'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.603418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1023/2030] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:41.609670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e9dbefea434acf980577c4f0715180'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.617514 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e9dbefea434acf980577c4f0715180'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.618717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e9dbefea434acf980577c4f0715180'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.619515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e9dbefea434acf980577c4f0715180'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.639187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1008/2031] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:41 2022] DELETE /identity/v3/users/28e9dbefea434acf980577c4f0715180 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:41.643884 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e812de-8c89-41e5-b28b-357067bc306c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:41.644152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e812de-8c89-41e5-b28b-357067bc306c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:41.644976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e812de-8c89-41e5-b28b-357067bc306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:41.666645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c5e812de-8c89-41e5-b28b-357067bc306c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:41.666645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c5e812de-8c89-41e5-b28b-357067bc306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:41.716350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:41.717995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:41.749527 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1024/2032] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:41.759691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e812de-8c89-41e5-b28b-357067bc306c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:41.761275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c5e812de-8c89-41e5-b28b-357067bc306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:41.797537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcef1aa-7a65-465f-9139-e38c47b15d2d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:41.805289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:41.806519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:41.806807 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:41.812211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] PATH_INFO: `/v3/users/3be143a327914afc9252f7190a1c1759` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:41.816833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be143a327914afc9252f7190a1c1759)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:41.824684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:41.838946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e812de-8c89-41e5-b28b-357067bc306c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:41.843193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d086af7-53a4-43c4-bfd1-36d0f09c5281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:41.843972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d086af7-53a4-43c4-bfd1-36d0f09c5281 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:41.844357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d086af7-53a4-43c4-bfd1-36d0f09c5281 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:41.844642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d086af7-53a4-43c4-bfd1-36d0f09c5281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:41.856758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d086af7-53a4-43c4-bfd1-36d0f09c5281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:41.858704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d086af7-53a4-43c4-bfd1-36d0f09c5281 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:41.882134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1025/2033] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:41.955082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be143a327914afc9252f7190a1c1759'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.963859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be143a327914afc9252f7190a1c1759'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.975951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be143a327914afc9252f7190a1c1759'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.977788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be143a327914afc9252f7190a1c1759'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:41.978775 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be143a327914afc9252f7190a1c1759'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.015980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1009/2034] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:41 2022] DELETE /identity/v3/users/3be143a327914afc9252f7190a1c1759 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:42.021720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74aca6-b5d1-4432-848c-3b735a515b2b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:42.023179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74aca6-b5d1-4432-848c-3b735a515b2b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:42.023655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74aca6-b5d1-4432-848c-3b735a515b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:42.044431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4c74aca6-b5d1-4432-848c-3b735a515b2b None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:42.046157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4c74aca6-b5d1-4432-848c-3b735a515b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:42.184717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1026/2035] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:42.255066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:42.257050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:42.369957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cf36e-2f76-472a-8f61-dfaa27306b47 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:42.375783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd22f56-1b90-40d1-88b7-594cfde02d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:42.376526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd22f56-1b90-40d1-88b7-594cfde02d2c service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:42.376806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd22f56-1b90-40d1-88b7-594cfde02d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:42.377080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd22f56-1b90-40d1-88b7-594cfde02d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:42.389830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd22f56-1b90-40d1-88b7-594cfde02d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:42.391374 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd22f56-1b90-40d1-88b7-594cfde02d2c service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:42.402616 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1010/2036] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:42.498558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74aca6-b5d1-4432-848c-3b735a515b2b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:42.500734 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4c74aca6-b5d1-4432-848c-3b735a515b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:42.505455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd22f56-1b90-40d1-88b7-594cfde02d2c service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:42.507896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bbd22f56-1b90-40d1-88b7-594cfde02d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:42.523509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74aca6-b5d1-4432-848c-3b735a515b2b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:42.529220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:42.531465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:42.531952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:42.532378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] PATH_INFO: `/v3/projects/64fb0b4f9ef0493dac9c225a96e2d62f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:42.534663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64fb0b4f9ef0493dac9c225a96e2d62f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:42.537067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:42.543669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd22f56-1b90-40d1-88b7-594cfde02d2c service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:42.557197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:42.558186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:42.559438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:42.559816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] PATH_INFO: `/v3/projects/0f759bc9c549400cb10e8b7e62880e4f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:42.562187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f759bc9c549400cb10e8b7e62880e4f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:42.565537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:42.594624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64fb0b4f9ef0493dac9c225a96e2d62f', 'request_id': 'req-e0930864-4098-4be7-9e4c-ac9c69e38ea7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.603084 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64fb0b4f9ef0493dac9c225a96e2d62f', 'request_id': 'req-e0930864-4098-4be7-9e4c-ac9c69e38ea7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.615833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64fb0b4f9ef0493dac9c225a96e2d62f', 'request_id': 'req-e0930864-4098-4be7-9e4c-ac9c69e38ea7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.620563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f759bc9c549400cb10e8b7e62880e4f', 'request_id': 'req-956b2fd8-578d-4798-b4ba-18a3aa85252b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.626619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f759bc9c549400cb10e8b7e62880e4f', 'request_id': 'req-956b2fd8-578d-4798-b4ba-18a3aa85252b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.627955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] The token cache is being invalidate because project 64fb0b4f9ef0493dac9c225a96e2d62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:42.628247 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.629478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.631028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1027/2037] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:42 2022] DELETE /identity/v3/projects/64fb0b4f9ef0493dac9c225a96e2d62f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:42.633319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f759bc9c549400cb10e8b7e62880e4f', 'request_id': 'req-956b2fd8-578d-4798-b4ba-18a3aa85252b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.634712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:42.636116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:42.646979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] The token cache is being invalidate because project 0f759bc9c549400cb10e8b7e62880e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:42.647353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.648181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.650039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1011/2038] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:42 2022] DELETE /identity/v3/projects/0f759bc9c549400cb10e8b7e62880e4f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:42.654060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:42.655499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:42.737319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0930864-4098-4be7-9e4c-ac9c69e38ea7 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:42.742302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b2fd8-578d-4798-b4ba-18a3aa85252b admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:42.744472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:42.745421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:42.745773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:42.746319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] PATH_INFO: `/v3/users/1bd26bc11df74d2db78106601d783824` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:42.747558 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:42.747697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd26bc11df74d2db78106601d783824)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:42.748565 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:42.748918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:42.749261 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] PATH_INFO: `/v3/users/5a7ddf26fdb84b9b855bbfb8b31af8a8` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:42.749925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:42.750649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7ddf26fdb84b9b855bbfb8b31af8a8)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:42.752737 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:42.803195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd26bc11df74d2db78106601d783824'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.806957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7ddf26fdb84b9b855bbfb8b31af8a8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.810585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd26bc11df74d2db78106601d783824'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.814316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7ddf26fdb84b9b855bbfb8b31af8a8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.818551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd26bc11df74d2db78106601d783824'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.819622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd26bc11df74d2db78106601d783824'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.820592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd26bc11df74d2db78106601d783824'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.822642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7ddf26fdb84b9b855bbfb8b31af8a8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.823317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7ddf26fdb84b9b855bbfb8b31af8a8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.824067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7ddf26fdb84b9b855bbfb8b31af8a8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:42.840829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1028/2039] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:42 2022] DELETE /identity/v3/users/1bd26bc11df74d2db78106601d783824 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:42.841706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:42.848293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1012/2040] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:42 2022] DELETE /identity/v3/users/5a7ddf26fdb84b9b855bbfb8b31af8a8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:42.848464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:42.915684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070966a9-bef8-46b1-9037-335d21e019f5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:42.986510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:42.988128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:42.988668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:42.989255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] PATH_INFO: `/v3/projects/6fccffe09802464d82f812f6413c8b75` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:42.990756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fccffe09802464d82f812f6413c8b75)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:42.992384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:43.058630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fccffe09802464d82f812f6413c8b75', 'request_id': 'req-01d67502-518c-41fd-8f63-4162d4c5bd60'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.066053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fccffe09802464d82f812f6413c8b75', 'request_id': 'req-01d67502-518c-41fd-8f63-4162d4c5bd60'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.072844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fccffe09802464d82f812f6413c8b75', 'request_id': 'req-01d67502-518c-41fd-8f63-4162d4c5bd60'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.082812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] The token cache is being invalidate because project 6fccffe09802464d82f812f6413c8b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:43.083094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.083780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.089137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1029/2041] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:42 2022] DELETE /identity/v3/projects/6fccffe09802464d82f812f6413c8b75 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:43.093138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:43.094627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:43.117543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5bf4c-5b57-4a43-9c67-d988b1599e4d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:43.193885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:43.194820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.195103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.195378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] PATH_INFO: `/v3/users/ce17051e47214834bb1d750aa90a68cb` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.196601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce17051e47214834bb1d750aa90a68cb)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:43.198574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:43.233262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:43.235217 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:43.264447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d67502-518c-41fd-8f63-4162d4c5bd60 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:43.273017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:43.273904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.274315 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.274788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] PATH_INFO: `/v3/projects/146dab4945954272aafe58868c77ca89` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.276559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=146dab4945954272aafe58868c77ca89)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:43.278694 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:43.329757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce17051e47214834bb1d750aa90a68cb'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.340145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce17051e47214834bb1d750aa90a68cb'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.349994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce17051e47214834bb1d750aa90a68cb'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.351918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce17051e47214834bb1d750aa90a68cb'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.352443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce17051e47214834bb1d750aa90a68cb'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.356706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '146dab4945954272aafe58868c77ca89', 'request_id': 'req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.366758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '146dab4945954272aafe58868c77ca89', 'request_id': 'req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.373874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '146dab4945954272aafe58868c77ca89', 'request_id': 'req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.382454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1013/2042] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:43 2022] DELETE /identity/v3/users/ce17051e47214834bb1d750aa90a68cb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:43.382454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:43.382454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:43.390294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] The token cache is being invalidate because project 146dab4945954272aafe58868c77ca89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:43.390496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.391352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-e8ee759d-5bbb-4f76-b5d3-cb8ea65c54ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.397337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1030/2043] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:43 2022] DELETE /identity/v3/projects/146dab4945954272aafe58868c77ca89 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:43.399356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea593-13eb-4420-9a41-a8b2699c5fcc None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.399652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea593-13eb-4420-9a41-a8b2699c5fcc None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.399977 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ea593-13eb-4420-9a41-a8b2699c5fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.424256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-703ea593-13eb-4420-9a41-a8b2699c5fcc None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:43.425513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-703ea593-13eb-4420-9a41-a8b2699c5fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:43.464768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a8340-20d9-440d-9a36-4b6eaae6eea3 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:43.471311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:43.472207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.473015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.473300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] PATH_INFO: `/v3/projects/d06c2473c6e64d05a6615ce732da0db8` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.474684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06c2473c6e64d05a6615ce732da0db8)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:43.477497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:43.531989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1031/2044] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:43.534200 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd786d-6c4b-4397-9b31-6b0b42e324aa None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.534639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd786d-6c4b-4397-9b31-6b0b42e324aa None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.535481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd786d-6c4b-4397-9b31-6b0b42e324aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.562615 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-12fd786d-6c4b-4397-9b31-6b0b42e324aa None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:43.564117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-12fd786d-6c4b-4397-9b31-6b0b42e324aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:43.580664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1032/2045] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:43.583012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd786d-6c4b-4397-9b31-6b0b42e324aa None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:43.594111 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06c2473c6e64d05a6615ce732da0db8', 'request_id': 'req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.597471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd786d-6c4b-4397-9b31-6b0b42e324aa None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:43.602380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06c2473c6e64d05a6615ce732da0db8', 'request_id': 'req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.608740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06c2473c6e64d05a6615ce732da0db8', 'request_id': 'req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.631444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] The token cache is being invalidate because project d06c2473c6e64d05a6615ce732da0db8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:43.631747 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.632619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-216ce0f1-51e3-49a7-8b0e-71b2bdf57d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:43.637435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1014/2046] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:43 2022] DELETE /identity/v3/projects/d06c2473c6e64d05a6615ce732da0db8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:43.641931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a606f-4c5f-4d99-8343-6446057b3dc5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.642196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a606f-4c5f-4d99-8343-6446057b3dc5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.642569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a606f-4c5f-4d99-8343-6446057b3dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.686756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ef3a606f-4c5f-4d99-8343-6446057b3dc5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:43.688002 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ef3a606f-4c5f-4d99-8343-6446057b3dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:43.732866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:43.733656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.733972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.734864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.736545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:43.737567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:43.742368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:43.786903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1033/2047] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:43.789436 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:43.793769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:43.817589 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192ee99-a4f8-4e43-87ad-049f412114ed admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:43.828194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5e20-89a0-4a76-afd2-0bc94f7040bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:43.829014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5e20-89a0-4a76-afd2-0bc94f7040bb admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.829402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5e20-89a0-4a76-afd2-0bc94f7040bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.829790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5e20-89a0-4a76-afd2-0bc94f7040bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.830620 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd5e20-89a0-4a76-afd2-0bc94f7040bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:43.833035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1015/2048] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:43.840006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd5e20-89a0-4a76-afd2-0bc94f7040bb admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:43.841159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0ca67-a0b7-42fe-9acb-eaca92a0bb88 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.841517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0ca67-a0b7-42fe-9acb-eaca92a0bb88 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.841970 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0ca67-a0b7-42fe-9acb-eaca92a0bb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.894820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1034/2049] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:43 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:43.896785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5e20-89a0-4a76-afd2-0bc94f7040bb admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:43.897933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5ba0ca67-a0b7-42fe-9acb-eaca92a0bb88 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:43.899183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5ba0ca67-a0b7-42fe-9acb-eaca92a0bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:43.979144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5e20-89a0-4a76-afd2-0bc94f7040bb admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:43.986905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1016/2050] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:43.987022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8967fa5-a6b9-4966-a27e-40e743ce18e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:43.987623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8967fa5-a6b9-4966-a27e-40e743ce18e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:43.987911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8967fa5-a6b9-4966-a27e-40e743ce18e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:43.988802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0ca67-a0b7-42fe-9acb-eaca92a0bb88 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:43.990294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8967fa5-a6b9-4966-a27e-40e743ce18e1 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:43.990656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5ba0ca67-a0b7-42fe-9acb-eaca92a0bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:43.991369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8967fa5-a6b9-4966-a27e-40e743ce18e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:43.993564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8967fa5-a6b9-4966-a27e-40e743ce18e1 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.003930 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0ca67-a0b7-42fe-9acb-eaca92a0bb88 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.009822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.010781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.011062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.011337 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] PATH_INFO: `/v3/projects/d233835b6dcf40558c0320b960ecfb98` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.012521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d233835b6dcf40558c0320b960ecfb98)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.014468 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.017300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1035/2051] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:43 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:44.018563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8967fa5-a6b9-4966-a27e-40e743ce18e1 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.030384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8967fa5-a6b9-4966-a27e-40e743ce18e1 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.035682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c56d1-824a-4184-82d1-577335f31c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.036382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c56d1-824a-4184-82d1-577335f31c70 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.036662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c56d1-824a-4184-82d1-577335f31c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.036933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c56d1-824a-4184-82d1-577335f31c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.037647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c56d1-824a-4184-82d1-577335f31c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:44.037950 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c56d1-824a-4184-82d1-577335f31c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.039764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c56d1-824a-4184-82d1-577335f31c70 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.051910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1036/2052] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:44.052939 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c56d1-824a-4184-82d1-577335f31c70 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.062909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c56d1-824a-4184-82d1-577335f31c70 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.064184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd233835b6dcf40558c0320b960ecfb98', 'request_id': 'req-a11ebf7e-3a3a-4997-b92d-8a2defa97120'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:44.070121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd233835b6dcf40558c0320b960ecfb98', 'request_id': 'req-a11ebf7e-3a3a-4997-b92d-8a2defa97120'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:44.075434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd233835b6dcf40558c0320b960ecfb98', 'request_id': 'req-a11ebf7e-3a3a-4997-b92d-8a2defa97120'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:44.089070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] The token cache is being invalidate because project d233835b6dcf40558c0320b960ecfb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:44.089440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:44.090079 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:44.091942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1017/2053] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:43 2022] DELETE /identity/v3/projects/d233835b6dcf40558c0320b960ecfb98 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:44.092739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.094059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:44.119397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee25b1-63ee-48d5-b28a-c4b2dfba405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.120063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee25b1-63ee-48d5-b28a-c4b2dfba405d admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.120346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee25b1-63ee-48d5-b28a-c4b2dfba405d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.120624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee25b1-63ee-48d5-b28a-c4b2dfba405d admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.121373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee25b1-63ee-48d5-b28a-c4b2dfba405d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.122991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee25b1-63ee-48d5-b28a-c4b2dfba405d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.133083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1037/2054] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:44.134331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d16fa-afbc-4020-a540-0c7714275118 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.134619 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d16fa-afbc-4020-a540-0c7714275118 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.134894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d16fa-afbc-4020-a540-0c7714275118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.152906 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f95d16fa-afbc-4020-a540-0c7714275118 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:44.154084 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f95d16fa-afbc-4020-a540-0c7714275118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:44.157338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ebf7e-3a3a-4997-b92d-8a2defa97120 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.162502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a621fae-7bff-4821-813b-165e75e7e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.162655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1038/2055] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:44.163480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d16fa-afbc-4020-a540-0c7714275118 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.164703 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f95d16fa-afbc-4020-a540-0c7714275118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:44.168984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a621fae-7bff-4821-813b-165e75e7e74d admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.169275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a621fae-7bff-4821-813b-165e75e7e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.169571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a621fae-7bff-4821-813b-165e75e7e74d admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.170257 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a621fae-7bff-4821-813b-165e75e7e74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.172159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a621fae-7bff-4821-813b-165e75e7e74d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.175970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d16fa-afbc-4020-a540-0c7714275118 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.180550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb884f-8731-4fdc-8613-5e9e5cefd4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.181191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb884f-8731-4fdc-8613-5e9e5cefd4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.181817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb884f-8731-4fdc-8613-5e9e5cefd4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.181817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb884f-8731-4fdc-8613-5e9e5cefd4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.182480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb884f-8731-4fdc-8613-5e9e5cefd4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.184082 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb884f-8731-4fdc-8613-5e9e5cefd4e0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.194334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1039/2056] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:44.195406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d17e-5363-4244-b260-4f769a870c3c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.195693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d17e-5363-4244-b260-4f769a870c3c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.195969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d17e-5363-4244-b260-4f769a870c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.197226 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1018/2057] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:44.198613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a621fae-7bff-4821-813b-165e75e7e74d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.216802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-7815d17e-5363-4244-b260-4f769a870c3c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:44.217907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7815d17e-5363-4244-b260-4f769a870c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:44.257577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a621fae-7bff-4821-813b-165e75e7e74d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.262241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e10e4-2758-4ec8-95dd-5a32b9cbb39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.263177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e10e4-2758-4ec8-95dd-5a32b9cbb39a admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.263484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e10e4-2758-4ec8-95dd-5a32b9cbb39a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.263755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e10e4-2758-4ec8-95dd-5a32b9cbb39a admin admin] PATH_INFO: `/v3/projects/a346ba9339234082b4ff275230470977/users/b0fa9cf7a3fe4b59913eaa3c7f82b944/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.275064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1040/2058] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:44.276208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815d17e-5363-4244-b260-4f769a870c3c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.279790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e10e4-2758-4ec8-95dd-5a32b9cbb39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a346ba9339234082b4ff275230470977, user_id=b0fa9cf7a3fe4b59913eaa3c7f82b944, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.282455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e10e4-2758-4ec8-95dd-5a32b9cbb39a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.285633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815d17e-5363-4244-b260-4f769a870c3c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.290652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5a8c2-9703-45c4-b343-aa7c7aa335e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.291313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5a8c2-9703-45c4-b343-aa7c7aa335e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.291593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5a8c2-9703-45c4-b343-aa7c7aa335e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.291870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5a8c2-9703-45c4-b343-aa7c7aa335e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.292553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5a8c2-9703-45c4-b343-aa7c7aa335e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.294505 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5a8c2-9703-45c4-b343-aa7c7aa335e9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.295382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1019/2059] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:44 2022] PUT /identity/v3/projects/a346ba9339234082b4ff275230470977/users/b0fa9cf7a3fe4b59913eaa3c7f82b944/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:44.296117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e10e4-2758-4ec8-95dd-5a32b9cbb39a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.314602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1041/2060] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/users => generated 300 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:44.320234 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43993b11-6508-4967-834e-6fcbf577b84b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.320526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43993b11-6508-4967-834e-6fcbf577b84b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.320810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43993b11-6508-4967-834e-6fcbf577b84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.350940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-43993b11-6508-4967-834e-6fcbf577b84b None None] MFA Rules not processed for user `b0fa9cf7a3fe4b59913eaa3c7f82b944`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:44.352165 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-43993b11-6508-4967-834e-6fcbf577b84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:44.361577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e10e4-2758-4ec8-95dd-5a32b9cbb39a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.367936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c561b-f5f4-4d73-aea2-64a56e14e3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.368709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c561b-f5f4-4d73-aea2-64a56e14e3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.369414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c561b-f5f4-4d73-aea2-64a56e14e3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.369414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c561b-f5f4-4d73-aea2-64a56e14e3b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.370519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c561b-f5f4-4d73-aea2-64a56e14e3b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:44.371008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c561b-f5f4-4d73-aea2-64a56e14e3b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.372886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c561b-f5f4-4d73-aea2-64a56e14e3b7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.388230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1020/2061] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:26:44.388230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c561b-f5f4-4d73-aea2-64a56e14e3b7 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.399458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c561b-f5f4-4d73-aea2-64a56e14e3b7 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.404962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2725d-8f37-4279-8086-94b580bfea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.405817 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2725d-8f37-4279-8086-94b580bfea61 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.406291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2725d-8f37-4279-8086-94b580bfea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.406577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2725d-8f37-4279-8086-94b580bfea61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.407307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2725d-8f37-4279-8086-94b580bfea61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.408870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2725d-8f37-4279-8086-94b580bfea61 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.419471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1021/2062] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:44.420473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2725d-8f37-4279-8086-94b580bfea61 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.427447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1042/2063] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:44.428907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43993b11-6508-4967-834e-6fcbf577b84b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.436068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2725d-8f37-4279-8086-94b580bfea61 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.439406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43993b11-6508-4967-834e-6fcbf577b84b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.440991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf8ec8-0423-47c9-ac03-83d58e04db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.441722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8ec8-0423-47c9-ac03-83d58e04db38 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.442008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8ec8-0423-47c9-ac03-83d58e04db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.442308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf8ec8-0423-47c9-ac03-83d58e04db38 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.442989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf8ec8-0423-47c9-ac03-83d58e04db38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.443928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a81c38-90df-4161-af07-45e6a6d18891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.444709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a81c38-90df-4161-af07-45e6a6d18891 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.444942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf8ec8-0423-47c9-ac03-83d58e04db38 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.445034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a81c38-90df-4161-af07-45e6a6d18891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.445254 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a81c38-90df-4161-af07-45e6a6d18891 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.445978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a81c38-90df-4161-af07-45e6a6d18891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.447607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a81c38-90df-4161-af07-45e6a6d18891 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.457892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1043/2064] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:44.461584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a81c38-90df-4161-af07-45e6a6d18891 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.463538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-85a81c38-90df-4161-af07-45e6a6d18891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:44.472009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1022/2065] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:44.473461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf8ec8-0423-47c9-ac03-83d58e04db38 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.520767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a81c38-90df-4161-af07-45e6a6d18891 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.532521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf8ec8-0423-47c9-ac03-83d58e04db38 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.537750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280508f-1f51-4661-80d4-15957b62c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.538653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280508f-1f51-4661-80d4-15957b62c8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.538933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280508f-1f51-4661-80d4-15957b62c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.539204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280508f-1f51-4661-80d4-15957b62c8b7 admin admin] PATH_INFO: `/v3/projects/77445f45cd8c48f684d25a6a821a538f/users/09304292974e4f378c448d2f15283a05/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.552917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280508f-1f51-4661-80d4-15957b62c8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77445f45cd8c48f684d25a6a821a538f, user_id=09304292974e4f378c448d2f15283a05, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.555865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280508f-1f51-4661-80d4-15957b62c8b7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.568268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5981308-4faf-40c4-99be-28bb8449cf81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaf01f45e7a429e9361eb176a3f7c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.568916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981308-4faf-40c4-99be-28bb8449cf81 service glance] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.569192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981308-4faf-40c4-99be-28bb8449cf81 service glance] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.569512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5981308-4faf-40c4-99be-28bb8449cf81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.571107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1023/2066] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:44 2022] PUT /identity/v3/projects/77445f45cd8c48f684d25a6a821a538f/users/09304292974e4f378c448d2f15283a05/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:44.572036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280508f-1f51-4661-80d4-15957b62c8b7 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.628813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5981308-4faf-40c4-99be-28bb8449cf81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.630430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5981308-4faf-40c4-99be-28bb8449cf81 service glance] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.637031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280508f-1f51-4661-80d4-15957b62c8b7 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.639344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1044/2067] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:44.640610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9eca-0135-47b8-85ea-d259dde86509 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.640905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9eca-0135-47b8-85ea-d259dde86509 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.641180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef9eca-0135-47b8-85ea-d259dde86509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.641990 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45c02-3acb-424c-891f-5777fbc33203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.642759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45c02-3acb-424c-891f-5777fbc33203 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.643112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45c02-3acb-424c-891f-5777fbc33203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.643462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45c02-3acb-424c-891f-5777fbc33203 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.644730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a45c02-3acb-424c-891f-5777fbc33203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.646768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a45c02-3acb-424c-891f-5777fbc33203 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.677231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-edef9eca-0135-47b8-85ea-d259dde86509 None None] MFA Rules not processed for user `09304292974e4f378c448d2f15283a05`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:44.678088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1024/2068] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:44.679199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-edef9eca-0135-47b8-85ea-d259dde86509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:44.681897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45c02-3acb-424c-891f-5777fbc33203 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.696696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45c02-3acb-424c-891f-5777fbc33203 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.703561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d393f-c3aa-4c06-92bc-055214f17d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.704348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d393f-c3aa-4c06-92bc-055214f17d8b admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.704719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d393f-c3aa-4c06-92bc-055214f17d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.705091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d393f-c3aa-4c06-92bc-055214f17d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.707276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d393f-c3aa-4c06-92bc-055214f17d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.708983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d393f-c3aa-4c06-92bc-055214f17d8b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.722420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1025/2069] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:44.725770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d393f-c3aa-4c06-92bc-055214f17d8b admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.736447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d393f-c3aa-4c06-92bc-055214f17d8b admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.741302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b984a1-d021-4f1a-9e7d-3eccb6e6f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.742077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b984a1-d021-4f1a-9e7d-3eccb6e6f049 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.742404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b984a1-d021-4f1a-9e7d-3eccb6e6f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.742709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b984a1-d021-4f1a-9e7d-3eccb6e6f049 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.743434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b984a1-d021-4f1a-9e7d-3eccb6e6f049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.745244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b984a1-d021-4f1a-9e7d-3eccb6e6f049 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.754480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1045/2070] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:44.755350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef9eca-0135-47b8-85ea-d259dde86509 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.756786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1026/2071] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:44.760662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b984a1-d021-4f1a-9e7d-3eccb6e6f049 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.766276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef9eca-0135-47b8-85ea-d259dde86509 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.773372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e62ef-4c0c-48f9-9016-c9189e30fc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.774208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e62ef-4c0c-48f9-9016-c9189e30fc6a admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.774674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e62ef-4c0c-48f9-9016-c9189e30fc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.774944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e62ef-4c0c-48f9-9016-c9189e30fc6a admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.775693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e62ef-4c0c-48f9-9016-c9189e30fc6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.777912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e62ef-4c0c-48f9-9016-c9189e30fc6a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.782907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b984a1-d021-4f1a-9e7d-3eccb6e6f049 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.788693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545f0df-94d2-4b56-b805-15780526a5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:44.790369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545f0df-94d2-4b56-b805-15780526a5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.790608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545f0df-94d2-4b56-b805-15780526a5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.790888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545f0df-94d2-4b56-b805-15780526a5bd admin admin] PATH_INFO: `/v3/projects/ec0eca7fe9a24543a698043517b5812c/users/e48a17fb542d4be49b08ace795959d8f/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.817261 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545f0df-94d2-4b56-b805-15780526a5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0eca7fe9a24543a698043517b5812c, user_id=e48a17fb542d4be49b08ace795959d8f, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:44.820482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545f0df-94d2-4b56-b805-15780526a5bd admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:44.828070 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1046/2072] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/projects => generated 401 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:44.832686 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e62ef-4c0c-48f9-9016-c9189e30fc6a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:44.844331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1027/2073] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:44 2022] PUT /identity/v3/projects/ec0eca7fe9a24543a698043517b5812c/users/e48a17fb542d4be49b08ace795959d8f/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:44.857789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20de70-eef1-4c4a-bf67-17bd222c43ba None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:44.858156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20de70-eef1-4c4a-bf67-17bd222c43ba None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:44.858541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20de70-eef1-4c4a-bf67-17bd222c43ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:44.892345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5b20de70-eef1-4c4a-bf67-17bd222c43ba None None] MFA Rules not processed for user `e48a17fb542d4be49b08ace795959d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:44.893991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5b20de70-eef1-4c4a-bf67-17bd222c43ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:44.923349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e62ef-4c0c-48f9-9016-c9189e30fc6a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:44.988599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1028/2074] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:44.995272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20de70-eef1-4c4a-bf67-17bd222c43ba None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.021621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70dfdc-25c8-430d-8dbb-1c85fa548fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.022388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70dfdc-25c8-430d-8dbb-1c85fa548fda admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.022688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70dfdc-25c8-430d-8dbb-1c85fa548fda admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.023042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70dfdc-25c8-430d-8dbb-1c85fa548fda admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.023735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70dfdc-25c8-430d-8dbb-1c85fa548fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.025689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70dfdc-25c8-430d-8dbb-1c85fa548fda admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.077792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1047/2075] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/users => generated 307 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:45.082316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70dfdc-25c8-430d-8dbb-1c85fa548fda admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.092862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70dfdc-25c8-430d-8dbb-1c85fa548fda admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.098512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19711-ad1c-4ecb-9d29-55ab0adeeffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.099071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20de70-eef1-4c4a-bf67-17bd222c43ba None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.099198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19711-ad1c-4ecb-9d29-55ab0adeeffd admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.099453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19711-ad1c-4ecb-9d29-55ab0adeeffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.099725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19711-ad1c-4ecb-9d29-55ab0adeeffd admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.100660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c19711-ad1c-4ecb-9d29-55ab0adeeffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.102392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c19711-ad1c-4ecb-9d29-55ab0adeeffd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.105929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4e937-5c73-4a0b-a5bf-a8d4d50402a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.106885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e937-5c73-4a0b-a5bf-a8d4d50402a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.107269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e937-5c73-4a0b-a5bf-a8d4d50402a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.107665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e937-5c73-4a0b-a5bf-a8d4d50402a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.108704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4e937-5c73-4a0b-a5bf-a8d4d50402a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.110760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4e937-5c73-4a0b-a5bf-a8d4d50402a9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.120452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1048/2076] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:45.122936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19711-ad1c-4ecb-9d29-55ab0adeeffd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.139678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19711-ad1c-4ecb-9d29-55ab0adeeffd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.142619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1029/2077] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:44 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:45.147748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4e937-5c73-4a0b-a5bf-a8d4d50402a9 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.149568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694731-6395-4ece-976a-6608fd4786e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.149935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694731-6395-4ece-976a-6608fd4786e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.150218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694731-6395-4ece-976a-6608fd4786e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.150548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694731-6395-4ece-976a-6608fd4786e0 admin admin] PATH_INFO: `/v3/projects/f1a7418f26b04be2bcd6a0bceb8e556a/users/96826a25c7514a2fa2a2e98785ff2b5b/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.166212 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25694731-6395-4ece-976a-6608fd4786e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7418f26b04be2bcd6a0bceb8e556a, user_id=96826a25c7514a2fa2a2e98785ff2b5b, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.169016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25694731-6395-4ece-976a-6608fd4786e0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.189070 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1049/2078] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:45 2022] PUT /identity/v3/projects/f1a7418f26b04be2bcd6a0bceb8e556a/users/96826a25c7514a2fa2a2e98785ff2b5b/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:45.193532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694731-6395-4ece-976a-6608fd4786e0 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.269732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4e937-5c73-4a0b-a5bf-a8d4d50402a9 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.276889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc1f1-b35e-4454-b00c-80fc9b1eefdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.277591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc1f1-b35e-4454-b00c-80fc9b1eefdf admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.277879 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc1f1-b35e-4454-b00c-80fc9b1eefdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.278158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc1f1-b35e-4454-b00c-80fc9b1eefdf admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.278880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc1f1-b35e-4454-b00c-80fc9b1eefdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.279894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694731-6395-4ece-976a-6608fd4786e0 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.281324 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc1f1-b35e-4454-b00c-80fc9b1eefdf admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.285249 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3e29-a9dd-49e2-b4c3-5a5dc58ec801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.286030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3e29-a9dd-49e2-b4c3-5a5dc58ec801 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.286468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3e29-a9dd-49e2-b4c3-5a5dc58ec801 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.286842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3e29-a9dd-49e2-b4c3-5a5dc58ec801 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.287687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f3e29-a9dd-49e2-b4c3-5a5dc58ec801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.289405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f3e29-a9dd-49e2-b4c3-5a5dc58ec801 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.304268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1050/2079] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:45.305788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3e29-a9dd-49e2-b4c3-5a5dc58ec801 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.308254 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1030/2080] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:45 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:45.312064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc1f1-b35e-4454-b00c-80fc9b1eefdf admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.322224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3e29-a9dd-49e2-b4c3-5a5dc58ec801 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.322706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc1f1-b35e-4454-b00c-80fc9b1eefdf admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.327816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5c864-be28-4644-8d01-385281dd4091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.328043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57cc1-cc29-403a-b312-1c539966bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.328703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57cc1-cc29-403a-b312-1c539966bce5 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.328803 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5c864-be28-4644-8d01-385281dd4091 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.328981 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57cc1-cc29-403a-b312-1c539966bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.329087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5c864-be28-4644-8d01-385281dd4091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.329362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f57cc1-cc29-403a-b312-1c539966bce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.329471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5c864-be28-4644-8d01-385281dd4091 admin admin] PATH_INFO: `/v3/projects/f1a7418f26b04be2bcd6a0bceb8e556a/users/96826a25c7514a2fa2a2e98785ff2b5b/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.330176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f57cc1-cc29-403a-b312-1c539966bce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.332725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f57cc1-cc29-403a-b312-1c539966bce5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.332858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5c864-be28-4644-8d01-385281dd4091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a7418f26b04be2bcd6a0bceb8e556a, user_id=96826a25c7514a2fa2a2e98785ff2b5b, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.336234 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5c864-be28-4644-8d01-385281dd4091 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.348377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1031/2081] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:45.352397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57cc1-cc29-403a-b312-1c539966bce5 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.355925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1051/2082] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:45 2022] PUT /identity/v3/projects/f1a7418f26b04be2bcd6a0bceb8e556a/users/96826a25c7514a2fa2a2e98785ff2b5b/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:45.366393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996009b-54bb-47e6-9490-2a113230d246 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.366687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996009b-54bb-47e6-9490-2a113230d246 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.366898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f57cc1-cc29-403a-b312-1c539966bce5 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.367018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996009b-54bb-47e6-9490-2a113230d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.398606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-7996009b-54bb-47e6-9490-2a113230d246 None None] MFA Rules not processed for user `96826a25c7514a2fa2a2e98785ff2b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:45.399919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7996009b-54bb-47e6-9490-2a113230d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:45.439250 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0519ede-fb0b-4c1c-b1a7-7f6331d372e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.440155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0519ede-fb0b-4c1c-b1a7-7f6331d372e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.440437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0519ede-fb0b-4c1c-b1a7-7f6331d372e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.441170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0519ede-fb0b-4c1c-b1a7-7f6331d372e9 admin admin] PATH_INFO: `/v3/projects/4eb89d1e53ca4f168a93b0a95beb0ba9/users/02c59182898a4124b9906540eec4c8b2/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.460963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0519ede-fb0b-4c1c-b1a7-7f6331d372e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb89d1e53ca4f168a93b0a95beb0ba9, user_id=02c59182898a4124b9906540eec4c8b2, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.464080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0519ede-fb0b-4c1c-b1a7-7f6331d372e9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.482680 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1052/2083] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:45.482832 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1032/2084] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:45 2022] PUT /identity/v3/projects/4eb89d1e53ca4f168a93b0a95beb0ba9/users/02c59182898a4124b9906540eec4c8b2/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:45.488319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996009b-54bb-47e6-9490-2a113230d246 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.490332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0519ede-fb0b-4c1c-b1a7-7f6331d372e9 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.492054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e0519ede-fb0b-4c1c-b1a7-7f6331d372e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:45.499211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996009b-54bb-47e6-9490-2a113230d246 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.554213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0519ede-fb0b-4c1c-b1a7-7f6331d372e9 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.555837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a02609-a915-44f7-95f4-4faf22e42975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.556509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a02609-a915-44f7-95f4-4faf22e42975 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.556792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a02609-a915-44f7-95f4-4faf22e42975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.557064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a02609-a915-44f7-95f4-4faf22e42975 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.557785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a02609-a915-44f7-95f4-4faf22e42975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.558311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d09f9-3940-46d0-bbe9-99bf45c8c302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.558953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d09f9-3940-46d0-bbe9-99bf45c8c302 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.559236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d09f9-3940-46d0-bbe9-99bf45c8c302 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.559396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a02609-a915-44f7-95f4-4faf22e42975 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.559496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d09f9-3940-46d0-bbe9-99bf45c8c302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.569289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1053/2085] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:45.573323 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a02609-a915-44f7-95f4-4faf22e42975 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.583367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a02609-a915-44f7-95f4-4faf22e42975 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.587988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b52b3-7001-45b1-890a-19dd4f2f4b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.589081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b52b3-7001-45b1-890a-19dd4f2f4b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.589365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b52b3-7001-45b1-890a-19dd4f2f4b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.589640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b52b3-7001-45b1-890a-19dd4f2f4b7c admin admin] PATH_INFO: `/v3/projects/4eb89d1e53ca4f168a93b0a95beb0ba9/users/02c59182898a4124b9906540eec4c8b2/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.591627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b52b3-7001-45b1-890a-19dd4f2f4b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb89d1e53ca4f168a93b0a95beb0ba9, user_id=02c59182898a4124b9906540eec4c8b2, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.594227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b52b3-7001-45b1-890a-19dd4f2f4b7c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.604747 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1054/2086] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:45 2022] PUT /identity/v3/projects/4eb89d1e53ca4f168a93b0a95beb0ba9/users/02c59182898a4124b9906540eec4c8b2/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:45.615532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24a3af-92ca-44f0-802b-99c337ef630f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.615818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24a3af-92ca-44f0-802b-99c337ef630f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.616320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24a3af-92ca-44f0-802b-99c337ef630f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.621189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d09f9-3940-46d0-bbe9-99bf45c8c302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.622683 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48d09f9-3940-46d0-bbe9-99bf45c8c302 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.632634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1033/2087] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:45.642042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-bf24a3af-92ca-44f0-802b-99c337ef630f None None] MFA Rules not processed for user `02c59182898a4124b9906540eec4c8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:45.643247 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bf24a3af-92ca-44f0-802b-99c337ef630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:45.711508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d09f9-3940-46d0-bbe9-99bf45c8c302 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.719744 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d09f9-3940-46d0-bbe9-99bf45c8c302 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.723185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1055/2088] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:45.734566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24a3af-92ca-44f0-802b-99c337ef630f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.735857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bf24a3af-92ca-44f0-802b-99c337ef630f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:45.768378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b61efe-8128-444a-ad65-d027faa6e669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.769045 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b61efe-8128-444a-ad65-d027faa6e669 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.769423 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b61efe-8128-444a-ad65-d027faa6e669 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.769754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b61efe-8128-444a-ad65-d027faa6e669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.791705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24a3af-92ca-44f0-802b-99c337ef630f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.795358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d98645-83d2-44d8-a97f-89b49f4c92a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.795999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d98645-83d2-44d8-a97f-89b49f4c92a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.796281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d98645-83d2-44d8-a97f-89b49f4c92a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.796559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d98645-83d2-44d8-a97f-89b49f4c92a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:45.805904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d98645-83d2-44d8-a97f-89b49f4c92a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.807568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d98645-83d2-44d8-a97f-89b49f4c92a7 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.817284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1056/2089] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:45.825597 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b61efe-8128-444a-ad65-d027faa6e669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:45.827057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b61efe-8128-444a-ad65-d027faa6e669 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:45.836276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1034/2090] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:45.934033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d98645-83d2-44d8-a97f-89b49f4c92a7 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:45.943266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d98645-83d2-44d8-a97f-89b49f4c92a7 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:45.946994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb421e2e-4207-4c74-95fd-5e21c2b56902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:45.947639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421e2e-4207-4c74-95fd-5e21c2b56902 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:45.947930 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421e2e-4207-4c74-95fd-5e21c2b56902 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:45.948205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421e2e-4207-4c74-95fd-5e21c2b56902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:46.011315 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb421e2e-4207-4c74-95fd-5e21c2b56902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:46.012801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb421e2e-4207-4c74-95fd-5e21c2b56902 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:46.022151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1057/2091] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:55.162011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b61efe-8128-444a-ad65-d027faa6e669 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:55.285626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b61efe-8128-444a-ad65-d027faa6e669 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:55.303712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:55.306806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:55.309842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:55.310229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] PATH_INFO: `/v3/users/e48a17fb542d4be49b08ace795959d8f` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:55.312617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48a17fb542d4be49b08ace795959d8f)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:55.317330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:55.327801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb421e2e-4207-4c74-95fd-5e21c2b56902 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:55.341144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb421e2e-4207-4c74-95fd-5e21c2b56902 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:55.351600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:55.352514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:55.352793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:55.353079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] PATH_INFO: `/v3/users/09304292974e4f378c448d2f15283a05` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:55.361266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09304292974e4f378c448d2f15283a05)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:55.364993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:55.412886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48a17fb542d4be49b08ace795959d8f'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.423292 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48a17fb542d4be49b08ace795959d8f'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.430658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09304292974e4f378c448d2f15283a05'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.439910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48a17fb542d4be49b08ace795959d8f'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.441814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09304292974e4f378c448d2f15283a05'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.441945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48a17fb542d4be49b08ace795959d8f'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.442618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-710ea996-b06e-4c46-9d10-ccb8762832d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48a17fb542d4be49b08ace795959d8f'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.460052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09304292974e4f378c448d2f15283a05'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.460664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09304292974e4f378c448d2f15283a05'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.462192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-de8a847d-da99-48e0-9408-00da406d6731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09304292974e4f378c448d2f15283a05'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:55.469429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1035/2092] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:55 2022] DELETE /identity/v3/users/e48a17fb542d4be49b08ace795959d8f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:55.470896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e58c0-942e-4955-895f-c5c41ff48796 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:55.471187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e58c0-942e-4955-895f-c5c41ff48796 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:55.471471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e58c0-942e-4955-895f-c5c41ff48796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:55.500294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1058/2093] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:55 2022] DELETE /identity/v3/users/09304292974e4f378c448d2f15283a05 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:55.500648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-640e58c0-942e-4955-895f-c5c41ff48796 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:55.500648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-640e58c0-942e-4955-895f-c5c41ff48796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:55.505572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5550b-a979-40a6-8921-c452d9ea09f3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:55.505944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5550b-a979-40a6-8921-c452d9ea09f3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:55.506226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5550b-a979-40a6-8921-c452d9ea09f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:55.524369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c2c5550b-a979-40a6-8921-c452d9ea09f3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:55.525886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c2c5550b-a979-40a6-8921-c452d9ea09f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:55.564146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1036/2094] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:55.574815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e58c0-942e-4955-895f-c5c41ff48796 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:55.580163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-640e58c0-942e-4955-895f-c5c41ff48796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:55.591094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1059/2095] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:55.600340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5550b-a979-40a6-8921-c452d9ea09f3 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:55.601755 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c2c5550b-a979-40a6-8921-c452d9ea09f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:55.649937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e58c0-942e-4955-895f-c5c41ff48796 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:55.654123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9250ef-f3bc-493a-80ad-dd7c14799616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:55.654840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9250ef-f3bc-493a-80ad-dd7c14799616 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:55.655124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9250ef-f3bc-493a-80ad-dd7c14799616 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:55.655699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9250ef-f3bc-493a-80ad-dd7c14799616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:55.666756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5550b-a979-40a6-8921-c452d9ea09f3 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:55.670752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9250ef-f3bc-493a-80ad-dd7c14799616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:55.672198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9250ef-f3bc-493a-80ad-dd7c14799616 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:55.672314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac656101-718c-4094-bdbe-f7015c6ba5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:55.672880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac656101-718c-4094-bdbe-f7015c6ba5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:55.673162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac656101-718c-4094-bdbe-f7015c6ba5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:55.673433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac656101-718c-4094-bdbe-f7015c6ba5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:55.682979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1037/2096] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:55.688019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac656101-718c-4094-bdbe-f7015c6ba5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:55.689943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac656101-718c-4094-bdbe-f7015c6ba5f5 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:55.701245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1060/2097] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:56.127359 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9250ef-f3bc-493a-80ad-dd7c14799616 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:56.132364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0d9250ef-f3bc-493a-80ad-dd7c14799616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:56.148245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9250ef-f3bc-493a-80ad-dd7c14799616 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:56.153152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac656101-718c-4094-bdbe-f7015c6ba5f5 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:56.154474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ac656101-718c-4094-bdbe-f7015c6ba5f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:56.165163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:56.166052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:56.167534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:56.167830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] PATH_INFO: `/v3/projects/ec0eca7fe9a24543a698043517b5812c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:56.169319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0eca7fe9a24543a698043517b5812c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:56.171286 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:56.174198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac656101-718c-4094-bdbe-f7015c6ba5f5 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:56.179311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:56.180191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:56.180453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:56.180883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] PATH_INFO: `/v3/projects/77445f45cd8c48f684d25a6a821a538f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:56.182589 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=77445f45cd8c48f684d25a6a821a538f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:56.185056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:56.231370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0eca7fe9a24543a698043517b5812c', 'request_id': 'req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.237667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0eca7fe9a24543a698043517b5812c', 'request_id': 'req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.242976 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0eca7fe9a24543a698043517b5812c', 'request_id': 'req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.244751 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77445f45cd8c48f684d25a6a821a538f', 'request_id': 'req-596ef119-c1fa-4351-ba9a-ca3a7a451dec'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.254141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77445f45cd8c48f684d25a6a821a538f', 'request_id': 'req-596ef119-c1fa-4351-ba9a-ca3a7a451dec'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.257548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] The token cache is being invalidate because project ec0eca7fe9a24543a698043517b5812c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:56.258380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.259490 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.261302 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77445f45cd8c48f684d25a6a821a538f', 'request_id': 'req-596ef119-c1fa-4351-ba9a-ca3a7a451dec'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.262033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1038/2098] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:56 2022] DELETE /identity/v3/projects/ec0eca7fe9a24543a698043517b5812c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:56.265594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:56.267280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:56.272265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] The token cache is being invalidate because project 77445f45cd8c48f684d25a6a821a538f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:56.272558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.273211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.274825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1061/2099] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:56 2022] DELETE /identity/v3/projects/77445f45cd8c48f684d25a6a821a538f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:56.278943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:56.280235 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:56.342343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f9a91-197b-4ae3-9b04-2c4c3bdfdce7 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:56.367382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef119-c1fa-4351-ba9a-ca3a7a451dec admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:56.373204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:56.374094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:56.374412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:56.374698 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] PATH_INFO: `/v3/users/96826a25c7514a2fa2a2e98785ff2b5b` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:56.376011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96826a25c7514a2fa2a2e98785ff2b5b)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:56.378095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:56.429109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:56.429524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:56.429832 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:56.430134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] PATH_INFO: `/v3/users/02c59182898a4124b9906540eec4c8b2` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:56.432202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c59182898a4124b9906540eec4c8b2)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:56.434676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:56.443271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96826a25c7514a2fa2a2e98785ff2b5b'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.455399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96826a25c7514a2fa2a2e98785ff2b5b'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.468275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96826a25c7514a2fa2a2e98785ff2b5b'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.469040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96826a25c7514a2fa2a2e98785ff2b5b'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.469674 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96826a25c7514a2fa2a2e98785ff2b5b'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.496007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1062/2100] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:56 2022] DELETE /identity/v3/users/96826a25c7514a2fa2a2e98785ff2b5b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:56.500644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c59182898a4124b9906540eec4c8b2'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.509462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c59182898a4124b9906540eec4c8b2'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.517954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c59182898a4124b9906540eec4c8b2'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.519614 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c59182898a4124b9906540eec4c8b2'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.520548 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c59182898a4124b9906540eec4c8b2'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:56.554140 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1039/2101] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:56 2022] DELETE /identity/v3/users/02c59182898a4124b9906540eec4c8b2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:56.966539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:56.968310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:57.014681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.016608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:57.045147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c97df-9e4d-4528-bd61-cf779e7b5910 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.088184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732823e7-653b-4674-beff-6f25c6fefe8e admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.092679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.093520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.093803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.094086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] PATH_INFO: `/v3/projects/4eb89d1e53ca4f168a93b0a95beb0ba9` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.095377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb89d1e53ca4f168a93b0a95beb0ba9)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.097301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.100457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.101379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.101729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.102003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] PATH_INFO: `/v3/projects/f1a7418f26b04be2bcd6a0bceb8e556a` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.103205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a7418f26b04be2bcd6a0bceb8e556a)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.105116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.142195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb89d1e53ca4f168a93b0a95beb0ba9', 'request_id': 'req-cc63b883-f693-4e32-bc16-b6c295db18d2'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.148983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb89d1e53ca4f168a93b0a95beb0ba9', 'request_id': 'req-cc63b883-f693-4e32-bc16-b6c295db18d2'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.149195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a7418f26b04be2bcd6a0bceb8e556a', 'request_id': 'req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.156092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb89d1e53ca4f168a93b0a95beb0ba9', 'request_id': 'req-cc63b883-f693-4e32-bc16-b6c295db18d2'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.156867 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a7418f26b04be2bcd6a0bceb8e556a', 'request_id': 'req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.163946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a7418f26b04be2bcd6a0bceb8e556a', 'request_id': 'req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.170137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] The token cache is being invalidate because project 4eb89d1e53ca4f168a93b0a95beb0ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:57.170669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.171130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-cc63b883-f693-4e32-bc16-b6c295db18d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.179784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1040/2102] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:57 2022] DELETE /identity/v3/projects/4eb89d1e53ca4f168a93b0a95beb0ba9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:57.179983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] The token cache is being invalidate because project f1a7418f26b04be2bcd6a0bceb8e556a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:57.179983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.179983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8aade5f3-23bb-4ea2-a3cc-0bfd2a939fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:57.179983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1063/2103] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:56 2022] DELETE /identity/v3/projects/f1a7418f26b04be2bcd6a0bceb8e556a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:57.181114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3145cd-27ea-4959-8eb9-40133adec81c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.181406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3145cd-27ea-4959-8eb9-40133adec81c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.181687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3145cd-27ea-4959-8eb9-40133adec81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.184458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231c8f-de41-4379-812e-59850d6664b3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.184745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231c8f-de41-4379-812e-59850d6664b3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.185028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231c8f-de41-4379-812e-59850d6664b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.204633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5f3145cd-27ea-4959-8eb9-40133adec81c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:57.204861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e6231c8f-de41-4379-812e-59850d6664b3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:57.206054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5f3145cd-27ea-4959-8eb9-40133adec81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:57.206421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e6231c8f-de41-4379-812e-59850d6664b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:57.275841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1041/2104] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:57.277731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b4715-f33e-4097-8d51-147c9ea7a751 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.278029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b4715-f33e-4097-8d51-147c9ea7a751 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.278329 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b4715-f33e-4097-8d51-147c9ea7a751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.281295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1064/2105] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:57.289090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b61d7-9598-4ea9-ae69-792d5dc60160 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.289470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b61d7-9598-4ea9-ae69-792d5dc60160 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.289756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b61d7-9598-4ea9-ae69-792d5dc60160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.298545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-757b4715-f33e-4097-8d51-147c9ea7a751 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:57.299756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-757b4715-f33e-4097-8d51-147c9ea7a751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:57.311007 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1042/2106] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:57.311415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-134b61d7-9598-4ea9-ae69-792d5dc60160 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:57.313213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-134b61d7-9598-4ea9-ae69-792d5dc60160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:57.315142 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b4715-f33e-4097-8d51-147c9ea7a751 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.321911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1065/2107] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:57.324568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b4715-f33e-4097-8d51-147c9ea7a751 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.325804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b61d7-9598-4ea9-ae69-792d5dc60160 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.329468 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627511c-1db3-4bc9-93db-01eb332e7faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.330120 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627511c-1db3-4bc9-93db-01eb332e7faa admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.330436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627511c-1db3-4bc9-93db-01eb332e7faa admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.330741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627511c-1db3-4bc9-93db-01eb332e7faa admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.331498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627511c-1db3-4bc9-93db-01eb332e7faa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:57.331804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627511c-1db3-4bc9-93db-01eb332e7faa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.333414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627511c-1db3-4bc9-93db-01eb332e7faa admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.335475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b61d7-9598-4ea9-ae69-792d5dc60160 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.339956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f3ce3-80aa-4916-8024-a795270231ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.340611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f3ce3-80aa-4916-8024-a795270231ba admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.340890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f3ce3-80aa-4916-8024-a795270231ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.341168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f3ce3-80aa-4916-8024-a795270231ba admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.341878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f3ce3-80aa-4916-8024-a795270231ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:26:57.342181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f3ce3-80aa-4916-8024-a795270231ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.343756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f3ce3-80aa-4916-8024-a795270231ba admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.344970 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1043/2108] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:26:57.349381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627511c-1db3-4bc9-93db-01eb332e7faa admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.356835 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1066/2109] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:26:57.359635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627511c-1db3-4bc9-93db-01eb332e7faa admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.361332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f3ce3-80aa-4916-8024-a795270231ba admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.364966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184baa4-cd77-4051-88b2-ba450aaa7c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.365630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184baa4-cd77-4051-88b2-ba450aaa7c19 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.365913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184baa4-cd77-4051-88b2-ba450aaa7c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.366192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184baa4-cd77-4051-88b2-ba450aaa7c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.366918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184baa4-cd77-4051-88b2-ba450aaa7c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.368859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184baa4-cd77-4051-88b2-ba450aaa7c19 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.373464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f3ce3-80aa-4916-8024-a795270231ba admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.380523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b77f3-fa6f-4cf5-b904-5db34e547edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.380523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b77f3-fa6f-4cf5-b904-5db34e547edd admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.380523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b77f3-fa6f-4cf5-b904-5db34e547edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.380523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b77f3-fa6f-4cf5-b904-5db34e547edd admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.381057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b77f3-fa6f-4cf5-b904-5db34e547edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.384404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b77f3-fa6f-4cf5-b904-5db34e547edd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.407946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1044/2110] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:57.412275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184baa4-cd77-4051-88b2-ba450aaa7c19 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.414662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1067/2111] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:57.418542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b77f3-fa6f-4cf5-b904-5db34e547edd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.479093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184baa4-cd77-4051-88b2-ba450aaa7c19 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.484201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6788a40-8b0f-4b5c-a559-fd24335c6620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.484889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6788a40-8b0f-4b5c-a559-fd24335c6620 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.485167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6788a40-8b0f-4b5c-a559-fd24335c6620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.485355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b77f3-fa6f-4cf5-b904-5db34e547edd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.485471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6788a40-8b0f-4b5c-a559-fd24335c6620 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.486121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6788a40-8b0f-4b5c-a559-fd24335c6620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.488129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6788a40-8b0f-4b5c-a559-fd24335c6620 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.490506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8529a-9d84-470e-9fd9-c926560e2912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.491324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8529a-9d84-470e-9fd9-c926560e2912 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.491613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8529a-9d84-470e-9fd9-c926560e2912 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.491888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8529a-9d84-470e-9fd9-c926560e2912 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.492780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8529a-9d84-470e-9fd9-c926560e2912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.494736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8529a-9d84-470e-9fd9-c926560e2912 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.511898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1045/2112] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:57.515655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6788a40-8b0f-4b5c-a559-fd24335c6620 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.520900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1068/2113] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:26:57.525072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8529a-9d84-470e-9fd9-c926560e2912 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.530782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6788a40-8b0f-4b5c-a559-fd24335c6620 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.535586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cebbd-05b2-4f28-af91-930cc8bf7467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.535720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8529a-9d84-470e-9fd9-c926560e2912 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.536273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cebbd-05b2-4f28-af91-930cc8bf7467 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.536543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cebbd-05b2-4f28-af91-930cc8bf7467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.536844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cebbd-05b2-4f28-af91-930cc8bf7467 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.537684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cebbd-05b2-4f28-af91-930cc8bf7467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.539524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cebbd-05b2-4f28-af91-930cc8bf7467 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.540519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52617e4-d233-44d1-a529-18f9054523b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.541218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52617e4-d233-44d1-a529-18f9054523b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.541502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52617e4-d233-44d1-a529-18f9054523b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.542099 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52617e4-d233-44d1-a529-18f9054523b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.542609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52617e4-d233-44d1-a529-18f9054523b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.544181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52617e4-d233-44d1-a529-18f9054523b8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.558228 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1069/2114] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:57.558777 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1046/2115] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:57.562017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52617e4-d233-44d1-a529-18f9054523b8 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.562189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cebbd-05b2-4f28-af91-930cc8bf7467 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.572521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52617e4-d233-44d1-a529-18f9054523b8 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.575250 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cebbd-05b2-4f28-af91-930cc8bf7467 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.585009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fca681-4a95-4e79-aa5f-ea116cc189d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.586279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1074f9-c973-4379-bbc5-bcc4589fa9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.586830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fca681-4a95-4e79-aa5f-ea116cc189d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.587109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fca681-4a95-4e79-aa5f-ea116cc189d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.587382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fca681-4a95-4e79-aa5f-ea116cc189d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.588122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1074f9-c973-4379-bbc5-bcc4589fa9fd admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.588400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1074f9-c973-4379-bbc5-bcc4589fa9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.588667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1074f9-c973-4379-bbc5-bcc4589fa9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.589397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1074f9-c973-4379-bbc5-bcc4589fa9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.590083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fca681-4a95-4e79-aa5f-ea116cc189d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.591590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fca681-4a95-4e79-aa5f-ea116cc189d6 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.594427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1074f9-c973-4379-bbc5-bcc4589fa9fd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.604767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1047/2116] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:57.606504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1070/2117] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:57.608903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1074f9-c973-4379-bbc5-bcc4589fa9fd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.610201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fca681-4a95-4e79-aa5f-ea116cc189d6 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.623837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fca681-4a95-4e79-aa5f-ea116cc189d6 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.625356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1074f9-c973-4379-bbc5-bcc4589fa9fd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.629270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d3c8b-ccb2-4b5e-9e1d-9ec7ff964903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.630310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3c8b-ccb2-4b5e-9e1d-9ec7ff964903 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.630721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3c8b-ccb2-4b5e-9e1d-9ec7ff964903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.630897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d3c8b-ccb2-4b5e-9e1d-9ec7ff964903 admin admin] PATH_INFO: `/v3/projects/05cdc311c2ce478388a9f495b27a48d2/users/e0a1fd53a4654a0ebcdfbe1d6f2012a5/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.631278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd1b5d-5e5e-444b-a99f-387ea6252972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.632346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1b5d-5e5e-444b-a99f-387ea6252972 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.634145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1b5d-5e5e-444b-a99f-387ea6252972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.634145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd1b5d-5e5e-444b-a99f-387ea6252972 admin admin] PATH_INFO: `/v3/projects/c9c4ffa0cbb74937a0bf7ff3a4c08526/users/f0a4827726dc409186e0ebfec8d8bd3b/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.646796 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d3c8b-ccb2-4b5e-9e1d-9ec7ff964903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cdc311c2ce478388a9f495b27a48d2, user_id=e0a1fd53a4654a0ebcdfbe1d6f2012a5, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.649432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd1b5d-5e5e-444b-a99f-387ea6252972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9c4ffa0cbb74937a0bf7ff3a4c08526, user_id=f0a4827726dc409186e0ebfec8d8bd3b, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.649588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d3c8b-ccb2-4b5e-9e1d-9ec7ff964903 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.654436 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd1b5d-5e5e-444b-a99f-387ea6252972 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.677270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1048/2118] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:57 2022] PUT /identity/v3/projects/05cdc311c2ce478388a9f495b27a48d2/users/e0a1fd53a4654a0ebcdfbe1d6f2012a5/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:57.685933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1071/2119] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:57 2022] PUT /identity/v3/projects/c9c4ffa0cbb74937a0bf7ff3a4c08526/users/f0a4827726dc409186e0ebfec8d8bd3b/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:57.689978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd03736-e285-43b5-ae94-b7d856f5fdf0 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.690443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd03736-e285-43b5-ae94-b7d856f5fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.691322 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd03736-e285-43b5-ae94-b7d856f5fdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.695117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff2eba-60df-435c-97a9-27fad24012e9 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.695436 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff2eba-60df-435c-97a9-27fad24012e9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.695689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff2eba-60df-435c-97a9-27fad24012e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.723493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6dd03736-e285-43b5-ae94-b7d856f5fdf0 None None] MFA Rules not processed for user `e0a1fd53a4654a0ebcdfbe1d6f2012a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:57.724732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6dd03736-e285-43b5-ae94-b7d856f5fdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:57.728180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-60ff2eba-60df-435c-97a9-27fad24012e9 None None] MFA Rules not processed for user `f0a4827726dc409186e0ebfec8d8bd3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:57.729355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-60ff2eba-60df-435c-97a9-27fad24012e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:57.810220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1072/2120] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:57.811794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1049/2121] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:57.811945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff2eba-60df-435c-97a9-27fad24012e9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.812926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd03736-e285-43b5-ae94-b7d856f5fdf0 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.886342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff2eba-60df-435c-97a9-27fad24012e9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.891377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee071ae-2660-4fda-a97f-153dab8801f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.892118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee071ae-2660-4fda-a97f-153dab8801f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.892409 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee071ae-2660-4fda-a97f-153dab8801f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.892690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee071ae-2660-4fda-a97f-153dab8801f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.893388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee071ae-2660-4fda-a97f-153dab8801f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.903781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee071ae-2660-4fda-a97f-153dab8801f1 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.913115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd03736-e285-43b5-ae94-b7d856f5fdf0 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:57.918858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4ce94-1a95-4f8c-8632-31cce3d99372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:57.919510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4ce94-1a95-4f8c-8632-31cce3d99372 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:57.919797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4ce94-1a95-4f8c-8632-31cce3d99372 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:57.920072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4ce94-1a95-4f8c-8632-31cce3d99372 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:57.920763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4ce94-1a95-4f8c-8632-31cce3d99372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:57.922765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4ce94-1a95-4f8c-8632-31cce3d99372 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:57.924058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1073/2122] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:57.932284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee071ae-2660-4fda-a97f-153dab8801f1 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:57.962596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1050/2123] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:57.966355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4ce94-1a95-4f8c-8632-31cce3d99372 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.028582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee071ae-2660-4fda-a97f-153dab8801f1 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.029298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4ce94-1a95-4f8c-8632-31cce3d99372 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.034004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cba2f8-3b61-4e8f-9636-c1e95ce540f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.034174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7d295-8a53-4e34-9faf-fbc9c0303764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.035292 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cba2f8-3b61-4e8f-9636-c1e95ce540f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.035574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cba2f8-3b61-4e8f-9636-c1e95ce540f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.035672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7d295-8a53-4e34-9faf-fbc9c0303764 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.035852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cba2f8-3b61-4e8f-9636-c1e95ce540f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.035961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7d295-8a53-4e34-9faf-fbc9c0303764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.036138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7d295-8a53-4e34-9faf-fbc9c0303764 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.036541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cba2f8-3b61-4e8f-9636-c1e95ce540f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.036815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7d295-8a53-4e34-9faf-fbc9c0303764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.038740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7d295-8a53-4e34-9faf-fbc9c0303764 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.039203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cba2f8-3b61-4e8f-9636-c1e95ce540f9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.058226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1074/2124] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:58.058704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1051/2125] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:26:57 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:26:58.061817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7d295-8a53-4e34-9faf-fbc9c0303764 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.064676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cba2f8-3b61-4e8f-9636-c1e95ce540f9 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.073470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7d295-8a53-4e34-9faf-fbc9c0303764 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.074222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cba2f8-3b61-4e8f-9636-c1e95ce540f9 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.078406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e75c-2f40-4903-90c7-239c3bb9c77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.078847 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47ae6-788e-4697-9881-1a67ecd4a38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.079343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e75c-2f40-4903-90c7-239c3bb9c77c admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.079512 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47ae6-788e-4697-9881-1a67ecd4a38a admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.079771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e75c-2f40-4903-90c7-239c3bb9c77c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.079867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47ae6-788e-4697-9881-1a67ecd4a38a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.080066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c47ae6-788e-4697-9881-1a67ecd4a38a admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.080234 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458e75c-2f40-4903-90c7-239c3bb9c77c admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.080797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47ae6-788e-4697-9881-1a67ecd4a38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.081125 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458e75c-2f40-4903-90c7-239c3bb9c77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.082961 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c47ae6-788e-4697-9881-1a67ecd4a38a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.083444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458e75c-2f40-4903-90c7-239c3bb9c77c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.092899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1052/2126] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:58.093827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1075/2127] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:26:58.097642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e75c-2f40-4903-90c7-239c3bb9c77c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.097797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47ae6-788e-4697-9881-1a67ecd4a38a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.107053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458e75c-2f40-4903-90c7-239c3bb9c77c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.107416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c47ae6-788e-4697-9881-1a67ecd4a38a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.112013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc9f3-a41c-4faa-af28-b312d497b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.113107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340b12-57d0-438e-b4d2-cb8dd4c8459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.113401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc9f3-a41c-4faa-af28-b312d497b850 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.113681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc9f3-a41c-4faa-af28-b312d497b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.113953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc9f3-a41c-4faa-af28-b312d497b850 admin admin] PATH_INFO: `/v3/projects/2a073193b4ac4f3b96b9ba90b899a7d0/users/08ee1532d84d4132a62fcdb643a2bad4/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.114047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340b12-57d0-438e-b4d2-cb8dd4c8459b admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.114341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340b12-57d0-438e-b4d2-cb8dd4c8459b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.114626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340b12-57d0-438e-b4d2-cb8dd4c8459b admin admin] PATH_INFO: `/v3/projects/462285053ff049d19e29aee4865b5811/users/3f032c81e24f411bb19ae919cfada746/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.128633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdc9f3-a41c-4faa-af28-b312d497b850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a073193b4ac4f3b96b9ba90b899a7d0, user_id=08ee1532d84d4132a62fcdb643a2bad4, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.128925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1340b12-57d0-438e-b4d2-cb8dd4c8459b admin admin] RBAC: Authorizing `identity:create_grant(project_id=462285053ff049d19e29aee4865b5811, user_id=3f032c81e24f411bb19ae919cfada746, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.131451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdc9f3-a41c-4faa-af28-b312d497b850 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.131743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1340b12-57d0-438e-b4d2-cb8dd4c8459b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.144871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1076/2128] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:58 2022] PUT /identity/v3/projects/2a073193b4ac4f3b96b9ba90b899a7d0/users/08ee1532d84d4132a62fcdb643a2bad4/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:58.145482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1053/2129] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:58 2022] PUT /identity/v3/projects/462285053ff049d19e29aee4865b5811/users/3f032c81e24f411bb19ae919cfada746/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:58.149189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc9f3-a41c-4faa-af28-b312d497b850 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.151293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340b12-57d0-438e-b4d2-cb8dd4c8459b admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.212044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc9f3-a41c-4faa-af28-b312d497b850 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.212727 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340b12-57d0-438e-b4d2-cb8dd4c8459b admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.217059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42ebe7-1544-4133-84af-ae505ba6ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.217836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e2117-15b2-4084-8c14-76e39d113349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.217993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42ebe7-1544-4133-84af-ae505ba6ecea admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.218217 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42ebe7-1544-4133-84af-ae505ba6ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.218526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e2117-15b2-4084-8c14-76e39d113349 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.218637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42ebe7-1544-4133-84af-ae505ba6ecea admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.218812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e2117-15b2-4084-8c14-76e39d113349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.219090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e2117-15b2-4084-8c14-76e39d113349 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.219274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42ebe7-1544-4133-84af-ae505ba6ecea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.219810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e2117-15b2-4084-8c14-76e39d113349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.221049 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42ebe7-1544-4133-84af-ae505ba6ecea admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.221395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e2117-15b2-4084-8c14-76e39d113349 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.231343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1077/2130] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:58.231509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1054/2131] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:26:58.235327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42ebe7-1544-4133-84af-ae505ba6ecea admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.235462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e2117-15b2-4084-8c14-76e39d113349 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.245255 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e2117-15b2-4084-8c14-76e39d113349 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.245414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42ebe7-1544-4133-84af-ae505ba6ecea admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.249904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16907b-38c3-42a6-bd93-36348e36e621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.250103 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7cdb-2b60-4dbe-995d-f295ff956d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.250894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16907b-38c3-42a6-bd93-36348e36e621 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.250991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7cdb-2b60-4dbe-995d-f295ff956d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.251185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16907b-38c3-42a6-bd93-36348e36e621 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.251279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7cdb-2b60-4dbe-995d-f295ff956d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.251465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16907b-38c3-42a6-bd93-36348e36e621 admin admin] PATH_INFO: `/v3/projects/462285053ff049d19e29aee4865b5811/users/3f032c81e24f411bb19ae919cfada746/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.251560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7cdb-2b60-4dbe-995d-f295ff956d4f admin admin] PATH_INFO: `/v3/projects/2a073193b4ac4f3b96b9ba90b899a7d0/users/08ee1532d84d4132a62fcdb643a2bad4/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.253980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16907b-38c3-42a6-bd93-36348e36e621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=462285053ff049d19e29aee4865b5811, user_id=3f032c81e24f411bb19ae919cfada746, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.254211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7cdb-2b60-4dbe-995d-f295ff956d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a073193b4ac4f3b96b9ba90b899a7d0, user_id=08ee1532d84d4132a62fcdb643a2bad4, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.256649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16907b-38c3-42a6-bd93-36348e36e621 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.256951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7cdb-2b60-4dbe-995d-f295ff956d4f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.270313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1078/2132] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:58 2022] PUT /identity/v3/projects/462285053ff049d19e29aee4865b5811/users/3f032c81e24f411bb19ae919cfada746/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:58.270554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1055/2133] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:26:58 2022] PUT /identity/v3/projects/2a073193b4ac4f3b96b9ba90b899a7d0/users/08ee1532d84d4132a62fcdb643a2bad4/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:26:58.278397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd4ea-61b1-4acc-a25f-7bd548c9ecfa None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.278695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd4ea-61b1-4acc-a25f-7bd548c9ecfa None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.278976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcd4ea-61b1-4acc-a25f-7bd548c9ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.281137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8aa1-adfd-436b-80be-049a6454e0f9 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.281431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8aa1-adfd-436b-80be-049a6454e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.281712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8aa1-adfd-436b-80be-049a6454e0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.311204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b9fcd4ea-61b1-4acc-a25f-7bd548c9ecfa None None] MFA Rules not processed for user `3f032c81e24f411bb19ae919cfada746`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:58.312243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-285f8aa1-adfd-436b-80be-049a6454e0f9 None None] MFA Rules not processed for user `08ee1532d84d4132a62fcdb643a2bad4`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:58.312492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b9fcd4ea-61b1-4acc-a25f-7bd548c9ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:58.313474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-285f8aa1-adfd-436b-80be-049a6454e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:58.386562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1079/2134] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:58.388836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1056/2135] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:26:58.397321 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcd4ea-61b1-4acc-a25f-7bd548c9ecfa None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.398839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b9fcd4ea-61b1-4acc-a25f-7bd548c9ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:58.399525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8aa1-adfd-436b-80be-049a6454e0f9 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:58.401599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-285f8aa1-adfd-436b-80be-049a6454e0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:58.465265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fcd4ea-61b1-4acc-a25f-7bd548c9ecfa None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.467165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8aa1-adfd-436b-80be-049a6454e0f9 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:58.468986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac921b5-ac4c-4472-afc4-142cc4f36f93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.469707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac921b5-ac4c-4472-afc4-142cc4f36f93 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.469944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac921b5-ac4c-4472-afc4-142cc4f36f93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.470221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac921b5-ac4c-4472-afc4-142cc4f36f93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.470898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966e735-ad8f-4fe4-a033-f51e4622bcd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:58.471547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966e735-ad8f-4fe4-a033-f51e4622bcd4 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:58.472030 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966e735-ad8f-4fe4-a033-f51e4622bcd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:58.472261 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966e735-ad8f-4fe4-a033-f51e4622bcd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:58.481415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966e735-ad8f-4fe4-a033-f51e4622bcd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.482941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966e735-ad8f-4fe4-a033-f51e4622bcd4 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.492741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1057/2136] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:26:58.542998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac921b5-ac4c-4472-afc4-142cc4f36f93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:58.544827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac921b5-ac4c-4472-afc4-142cc4f36f93 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:58.556121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1080/2137] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:59.257885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966e735-ad8f-4fe4-a033-f51e4622bcd4 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:59.318632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966e735-ad8f-4fe4-a033-f51e4622bcd4 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:59.323113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:59.323975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:59.324254 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:59.324526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] PATH_INFO: `/v3/users/f0a4827726dc409186e0ebfec8d8bd3b` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:59.325688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a4827726dc409186e0ebfec8d8bd3b)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:59.327609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:59.372389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a4827726dc409186e0ebfec8d8bd3b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.379431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a4827726dc409186e0ebfec8d8bd3b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.386823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a4827726dc409186e0ebfec8d8bd3b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.387437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a4827726dc409186e0ebfec8d8bd3b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.388053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a4827726dc409186e0ebfec8d8bd3b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.404737 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1058/2138] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:59 2022] DELETE /identity/v3/users/f0a4827726dc409186e0ebfec8d8bd3b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:59.409847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c30c-1acb-4ba5-b401-64c686cdd10a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:59.410373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c30c-1acb-4ba5-b401-64c686cdd10a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:59.410468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c30c-1acb-4ba5-b401-64c686cdd10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:59.427194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1853c30c-1acb-4ba5-b401-64c686cdd10a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:26:59.428371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1853c30c-1acb-4ba5-b401-64c686cdd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:59.485691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1081/2139] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:26:59.497051 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:59.498510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:59.558770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183351a-9b03-4c2c-8f61-56572f1e4661 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:59.562625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024a08f-34aa-489b-a096-24415121c495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:59.563266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024a08f-34aa-489b-a096-24415121c495 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:59.563547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024a08f-34aa-489b-a096-24415121c495 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:59.563825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024a08f-34aa-489b-a096-24415121c495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:59.573721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024a08f-34aa-489b-a096-24415121c495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:59.575175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024a08f-34aa-489b-a096-24415121c495 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:59.584844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1059/2140] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:26:59.867954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853c30c-1acb-4ba5-b401-64c686cdd10a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:59.869381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1853c30c-1acb-4ba5-b401-64c686cdd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:26:59.882364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1853c30c-1acb-4ba5-b401-64c686cdd10a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:26:59.886850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:26:59.887732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:26:59.888045 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:26:59.888430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] PATH_INFO: `/v3/projects/c9c4ffa0cbb74937a0bf7ff3a4c08526` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:26:59.889628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9c4ffa0cbb74937a0bf7ff3a4c08526)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:26:59.891563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:26:59.937689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9c4ffa0cbb74937a0bf7ff3a4c08526', 'request_id': 'req-b54febec-5da7-4fde-9717-17660d03e9df'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.944305 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9c4ffa0cbb74937a0bf7ff3a4c08526', 'request_id': 'req-b54febec-5da7-4fde-9717-17660d03e9df'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.950431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9c4ffa0cbb74937a0bf7ff3a4c08526', 'request_id': 'req-b54febec-5da7-4fde-9717-17660d03e9df'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.960345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] The token cache is being invalidate because project c9c4ffa0cbb74937a0bf7ff3a4c08526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:26:59.960653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.961268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:26:59.962819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1082/2141] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:26:59 2022] DELETE /identity/v3/projects/c9c4ffa0cbb74937a0bf7ff3a4c08526 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:26:59.966740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024a08f-34aa-489b-a096-24415121c495 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:26:59.976574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024a08f-34aa-489b-a096-24415121c495 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:00.033206 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:00.034076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:00.034903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:00.035293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] PATH_INFO: `/v3/users/08ee1532d84d4132a62fcdb643a2bad4` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:00.036494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ee1532d84d4132a62fcdb643a2bad4)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:00.038418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:00.084417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ee1532d84d4132a62fcdb643a2bad4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.091327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ee1532d84d4132a62fcdb643a2bad4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.098994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ee1532d84d4132a62fcdb643a2bad4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.099637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ee1532d84d4132a62fcdb643a2bad4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.100254 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5e7cc369-8626-4d42-aa3d-e7408de871fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ee1532d84d4132a62fcdb643a2bad4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.118469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1060/2142] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:26:59 2022] DELETE /identity/v3/users/08ee1532d84d4132a62fcdb643a2bad4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:00.519383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:00.521222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:00.535513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54febec-5da7-4fde-9717-17660d03e9df admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:00.590592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:00.591445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:00.591721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:00.591987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] PATH_INFO: `/v3/projects/2a073193b4ac4f3b96b9ba90b899a7d0` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:00.593140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a073193b4ac4f3b96b9ba90b899a7d0)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:00.595069 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:00.642729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a073193b4ac4f3b96b9ba90b899a7d0', 'request_id': 'req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.649665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a073193b4ac4f3b96b9ba90b899a7d0', 'request_id': 'req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.655951 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a073193b4ac4f3b96b9ba90b899a7d0', 'request_id': 'req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.666368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] The token cache is being invalidate because project 2a073193b4ac4f3b96b9ba90b899a7d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:00.666658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.667285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7f0e0c3a-41ff-4bd1-9eb2-041d80638d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:00.668815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1083/2143] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:00 2022] DELETE /identity/v3/projects/2a073193b4ac4f3b96b9ba90b899a7d0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:00.674212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31176dda-f73d-4c7c-823f-44a17e9a806d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:00.674659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31176dda-f73d-4c7c-823f-44a17e9a806d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:00.674780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31176dda-f73d-4c7c-823f-44a17e9a806d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:00.692916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-31176dda-f73d-4c7c-823f-44a17e9a806d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:00.694099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-31176dda-f73d-4c7c-823f-44a17e9a806d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:00.749664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1061/2144] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:00.757279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b684-a273-453d-b011-400baa80623a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:00.757566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b684-a273-453d-b011-400baa80623a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:00.757842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b684-a273-453d-b011-400baa80623a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:00.775183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-bae0b684-a273-453d-b011-400baa80623a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:00.776556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bae0b684-a273-453d-b011-400baa80623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:00.784089 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1084/2145] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:00.788874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31176dda-f73d-4c7c-823f-44a17e9a806d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:00.799215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31176dda-f73d-4c7c-823f-44a17e9a806d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:00.804708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1fd25-9446-466a-bc7a-a506cd8a618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:00.805391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1fd25-9446-466a-bc7a-a506cd8a618a admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:00.805665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1fd25-9446-466a-bc7a-a506cd8a618a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:00.805941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1fd25-9446-466a-bc7a-a506cd8a618a admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:00.806700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1fd25-9446-466a-bc7a-a506cd8a618a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:27:00.807087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1fd25-9446-466a-bc7a-a506cd8a618a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:00.808713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1fd25-9446-466a-bc7a-a506cd8a618a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:00.821608 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1062/2146] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:27:00.826569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0b684-a273-453d-b011-400baa80623a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:00.836888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0b684-a273-453d-b011-400baa80623a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:00.841594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530850db-781a-43e7-9268-7370ec7c03ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:00.842244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530850db-781a-43e7-9268-7370ec7c03ca admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:00.842647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530850db-781a-43e7-9268-7370ec7c03ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:00.843037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530850db-781a-43e7-9268-7370ec7c03ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:00.844207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530850db-781a-43e7-9268-7370ec7c03ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:00.845593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530850db-781a-43e7-9268-7370ec7c03ca admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:00.875078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1085/2147] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:00 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:27:00.879616 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1fd25-9446-466a-bc7a-a506cd8a618a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:00.889450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1fd25-9446-466a-bc7a-a506cd8a618a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:00.949485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9afb9-87f1-41a8-b905-84acd61abf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:00.950176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9afb9-87f1-41a8-b905-84acd61abf85 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:00.950493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9afb9-87f1-41a8-b905-84acd61abf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:00.950775 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9afb9-87f1-41a8-b905-84acd61abf85 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:00.951474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9afb9-87f1-41a8-b905-84acd61abf85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:00.953396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9afb9-87f1-41a8-b905-84acd61abf85 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:00.973713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1063/2148] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:00 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:00.978766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530850db-781a-43e7-9268-7370ec7c03ca admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:00.991107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530850db-781a-43e7-9268-7370ec7c03ca admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:00.997127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47146c-dffd-4086-afc7-a89e7b647de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:00.997920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47146c-dffd-4086-afc7-a89e7b647de9 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:00.998266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47146c-dffd-4086-afc7-a89e7b647de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:00.998576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47146c-dffd-4086-afc7-a89e7b647de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:00.999318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47146c-dffd-4086-afc7-a89e7b647de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.001281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47146c-dffd-4086-afc7-a89e7b647de9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.013095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1086/2149] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:01.017209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9afb9-87f1-41a8-b905-84acd61abf85 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.029434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9afb9-87f1-41a8-b905-84acd61abf85 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.036528 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843e217-0067-4983-b6ee-c354d489f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.036528 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843e217-0067-4983-b6ee-c354d489f9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.036528 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843e217-0067-4983-b6ee-c354d489f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.038435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843e217-0067-4983-b6ee-c354d489f9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.039252 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843e217-0067-4983-b6ee-c354d489f9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.040976 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843e217-0067-4983-b6ee-c354d489f9e9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.057000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1064/2150] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:01.058220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47146c-dffd-4086-afc7-a89e7b647de9 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.068852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47146c-dffd-4086-afc7-a89e7b647de9 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.075354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcf67c-4bec-49ad-b041-01f1a39808c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.076371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf67c-4bec-49ad-b041-01f1a39808c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.076677 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf67c-4bec-49ad-b041-01f1a39808c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.076954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bcf67c-4bec-49ad-b041-01f1a39808c6 admin admin] PATH_INFO: `/v3/projects/3c9973d8edeb428ea4eaf8defbd72389/users/445c5bf646c04e54a088e6e0d7236329/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.092459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcf67c-4bec-49ad-b041-01f1a39808c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9973d8edeb428ea4eaf8defbd72389, user_id=445c5bf646c04e54a088e6e0d7236329, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.095299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bcf67c-4bec-49ad-b041-01f1a39808c6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.109227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1087/2151] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:01 2022] PUT /identity/v3/projects/3c9973d8edeb428ea4eaf8defbd72389/users/445c5bf646c04e54a088e6e0d7236329/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:01.121003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae85ff6-6a82-4e45-9583-64f9048fe316 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.121298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae85ff6-6a82-4e45-9583-64f9048fe316 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.121578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae85ff6-6a82-4e45-9583-64f9048fe316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.148055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6ae85ff6-6a82-4e45-9583-64f9048fe316 None None] MFA Rules not processed for user `445c5bf646c04e54a088e6e0d7236329`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:01.149263 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6ae85ff6-6a82-4e45-9583-64f9048fe316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:01.215334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1065/2152] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:01.219996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcf67c-4bec-49ad-b041-01f1a39808c6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.280648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bcf67c-4bec-49ad-b041-01f1a39808c6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.285193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9fe33-b596-4093-90eb-63067248e6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.285858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9fe33-b596-4093-90eb-63067248e6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.286204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9fe33-b596-4093-90eb-63067248e6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.286518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9fe33-b596-4093-90eb-63067248e6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.287200 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9fe33-b596-4093-90eb-63067248e6f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.289076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9fe33-b596-4093-90eb-63067248e6f0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.321916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1088/2153] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:01 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:01.327255 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae85ff6-6a82-4e45-9583-64f9048fe316 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.345178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae85ff6-6a82-4e45-9583-64f9048fe316 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.413652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecec3c-2697-4a10-8198-daadd2439252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.414482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecec3c-2697-4a10-8198-daadd2439252 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.414841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecec3c-2697-4a10-8198-daadd2439252 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.415196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecec3c-2697-4a10-8198-daadd2439252 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.415975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecec3c-2697-4a10-8198-daadd2439252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.418278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecec3c-2697-4a10-8198-daadd2439252 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.446388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1066/2154] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:01 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:27:01.450798 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9fe33-b596-4093-90eb-63067248e6f0 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.464557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9fe33-b596-4093-90eb-63067248e6f0 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.482038 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069a12-5712-47db-a887-bfde86e4985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.482790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069a12-5712-47db-a887-bfde86e4985f admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.483102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069a12-5712-47db-a887-bfde86e4985f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.483402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069a12-5712-47db-a887-bfde86e4985f admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.486332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069a12-5712-47db-a887-bfde86e4985f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.486332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069a12-5712-47db-a887-bfde86e4985f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.507477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1089/2155] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:01.511442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecec3c-2697-4a10-8198-daadd2439252 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.521429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecec3c-2697-4a10-8198-daadd2439252 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.526242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e3505-defc-42d2-b05b-ab485ecbfb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.527148 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e3505-defc-42d2-b05b-ab485ecbfb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.527436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e3505-defc-42d2-b05b-ab485ecbfb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.527709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e3505-defc-42d2-b05b-ab485ecbfb50 admin admin] PATH_INFO: `/v3/projects/835e8daa85c749b2aed01f1daec14da6/users/f834f962517442cfb1dfd08ba95e4fae/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.545668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e3505-defc-42d2-b05b-ab485ecbfb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835e8daa85c749b2aed01f1daec14da6, user_id=f834f962517442cfb1dfd08ba95e4fae, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.548750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e3505-defc-42d2-b05b-ab485ecbfb50 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.564057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1067/2156] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:01 2022] PUT /identity/v3/projects/835e8daa85c749b2aed01f1daec14da6/users/f834f962517442cfb1dfd08ba95e4fae/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:01.568575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069a12-5712-47db-a887-bfde86e4985f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.579185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069a12-5712-47db-a887-bfde86e4985f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.636457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6a581-f7b2-45be-8d20-e02d8dd11166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.637133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a581-f7b2-45be-8d20-e02d8dd11166 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.637420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a581-f7b2-45be-8d20-e02d8dd11166 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.637700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a581-f7b2-45be-8d20-e02d8dd11166 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.638463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6a581-f7b2-45be-8d20-e02d8dd11166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.640165 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6a581-f7b2-45be-8d20-e02d8dd11166 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.649818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1090/2157] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:01.654484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e3505-defc-42d2-b05b-ab485ecbfb50 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.665121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e3505-defc-42d2-b05b-ab485ecbfb50 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.669793 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd07ba3-1f15-4be2-9685-58d8c14acfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.670795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd07ba3-1f15-4be2-9685-58d8c14acfb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.671080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd07ba3-1f15-4be2-9685-58d8c14acfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.671357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd07ba3-1f15-4be2-9685-58d8c14acfb8 admin admin] PATH_INFO: `/v3/projects/835e8daa85c749b2aed01f1daec14da6/users/f834f962517442cfb1dfd08ba95e4fae/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.673371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd07ba3-1f15-4be2-9685-58d8c14acfb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=835e8daa85c749b2aed01f1daec14da6, user_id=f834f962517442cfb1dfd08ba95e4fae, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.677358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd07ba3-1f15-4be2-9685-58d8c14acfb8 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.687905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1068/2158] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:01 2022] PUT /identity/v3/projects/835e8daa85c749b2aed01f1daec14da6/users/f834f962517442cfb1dfd08ba95e4fae/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:01.698276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b1e2-29b3-4623-8a83-e6485ecaa8a6 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.698590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b1e2-29b3-4623-8a83-e6485ecaa8a6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.698896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523b1e2-29b3-4623-8a83-e6485ecaa8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.724952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d523b1e2-29b3-4623-8a83-e6485ecaa8a6 None None] MFA Rules not processed for user `f834f962517442cfb1dfd08ba95e4fae`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:01.726153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d523b1e2-29b3-4623-8a83-e6485ecaa8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:01.790715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1091/2159] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:01.802100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd07ba3-1f15-4be2-9685-58d8c14acfb8 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.803834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5cd07ba3-1f15-4be2-9685-58d8c14acfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:01.863096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd07ba3-1f15-4be2-9685-58d8c14acfb8 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.866985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf73e1-134e-48df-a1eb-2a42f46af7ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.867655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf73e1-134e-48df-a1eb-2a42f46af7ce service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.867958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf73e1-134e-48df-a1eb-2a42f46af7ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.868392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf73e1-134e-48df-a1eb-2a42f46af7ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:01.878987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf73e1-134e-48df-a1eb-2a42f46af7ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:01.880446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf73e1-134e-48df-a1eb-2a42f46af7ce service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:01.890416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1069/2160] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:01.962131 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b1e2-29b3-4623-8a83-e6485ecaa8a6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:01.974058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523b1e2-29b3-4623-8a83-e6485ecaa8a6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:01.978498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60925d5e-067d-494e-869d-9805f85d42ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:01.979406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60925d5e-067d-494e-869d-9805f85d42ee service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:01.979697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60925d5e-067d-494e-869d-9805f85d42ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:01.979972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60925d5e-067d-494e-869d-9805f85d42ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:02.037550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60925d5e-067d-494e-869d-9805f85d42ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:02.039018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60925d5e-067d-494e-869d-9805f85d42ee service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:02.048153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1092/2161] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:02.309580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf73e1-134e-48df-a1eb-2a42f46af7ce service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:02.371322 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf73e1-134e-48df-a1eb-2a42f46af7ce service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:02.375861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:02.376753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:02.377030 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:02.377300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] PATH_INFO: `/v3/users/445c5bf646c04e54a088e6e0d7236329` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:02.379012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=445c5bf646c04e54a088e6e0d7236329)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:02.380917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:02.426358 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445c5bf646c04e54a088e6e0d7236329'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:02.433140 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445c5bf646c04e54a088e6e0d7236329'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:02.442051 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445c5bf646c04e54a088e6e0d7236329'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:02.442863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445c5bf646c04e54a088e6e0d7236329'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:02.443552 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445c5bf646c04e54a088e6e0d7236329'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:02.460290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1070/2162] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:27:02 2022] DELETE /identity/v3/users/445c5bf646c04e54a088e6e0d7236329 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:02.464771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32d904-d934-41dd-aba7-f3fe82a64747 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:02.465059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32d904-d934-41dd-aba7-f3fe82a64747 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:02.465337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32d904-d934-41dd-aba7-f3fe82a64747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:02.482032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3f32d904-d934-41dd-aba7-f3fe82a64747 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:02.483227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3f32d904-d934-41dd-aba7-f3fe82a64747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:02.546289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1093/2163] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:02.556564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:02.558209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:02.627532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ae49b-fa10-471d-9b4c-0425659eb48d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:02.632241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade84875-af27-4695-81e1-b05b2d63460b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:02.632911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade84875-af27-4695-81e1-b05b2d63460b service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:02.633199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade84875-af27-4695-81e1-b05b2d63460b service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:02.633480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade84875-af27-4695-81e1-b05b2d63460b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:02.648157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade84875-af27-4695-81e1-b05b2d63460b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:02.649605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade84875-af27-4695-81e1-b05b2d63460b service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:02.667940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1071/2164] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:03.096565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32d904-d934-41dd-aba7-f3fe82a64747 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:03.098627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3f32d904-d934-41dd-aba7-f3fe82a64747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:03.116317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32d904-d934-41dd-aba7-f3fe82a64747 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:03.121633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:03.122715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:03.122998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:03.123281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] PATH_INFO: `/v3/projects/3c9973d8edeb428ea4eaf8defbd72389` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:03.124495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c9973d8edeb428ea4eaf8defbd72389)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:03.126405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:03.176028 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c9973d8edeb428ea4eaf8defbd72389', 'request_id': 'req-45bd3997-3a7d-4902-a0ce-053b49fc67c7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.185230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c9973d8edeb428ea4eaf8defbd72389', 'request_id': 'req-45bd3997-3a7d-4902-a0ce-053b49fc67c7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.192750 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c9973d8edeb428ea4eaf8defbd72389', 'request_id': 'req-45bd3997-3a7d-4902-a0ce-053b49fc67c7'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.203463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] The token cache is being invalidate because project 3c9973d8edeb428ea4eaf8defbd72389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:03.203746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.204393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.205936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1094/2165] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:03 2022] DELETE /identity/v3/projects/3c9973d8edeb428ea4eaf8defbd72389 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:03.209963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade84875-af27-4695-81e1-b05b2d63460b service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:03.219599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade84875-af27-4695-81e1-b05b2d63460b service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:03.273493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:03.274407 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:03.274702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:03.274979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] PATH_INFO: `/v3/users/f834f962517442cfb1dfd08ba95e4fae` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:03.276584 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f834f962517442cfb1dfd08ba95e4fae)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:03.278521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:03.324448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f834f962517442cfb1dfd08ba95e4fae'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.331682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f834f962517442cfb1dfd08ba95e4fae'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.339445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f834f962517442cfb1dfd08ba95e4fae'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.339986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f834f962517442cfb1dfd08ba95e4fae'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.340591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f834f962517442cfb1dfd08ba95e4fae'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.360197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1072/2166] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:27:03 2022] DELETE /identity/v3/users/f834f962517442cfb1dfd08ba95e4fae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:03.639844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:03.641319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:03.663124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd3997-3a7d-4902-a0ce-053b49fc67c7 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:03.734997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:03.735905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:03.736197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:03.736609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] PATH_INFO: `/v3/projects/835e8daa85c749b2aed01f1daec14da6` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:03.738517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=835e8daa85c749b2aed01f1daec14da6)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:03.742822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:03.753871 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:03.755723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:03.771196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe2dec-a8b5-45da-af08-895379ec6cae admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:03.776690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:03.777748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:03.778187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:03.778647 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] PATH_INFO: `/v3/users/bdc08edc0e354ea0b8e41a2d81f3d9d4` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:03.779850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc08edc0e354ea0b8e41a2d81f3d9d4)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:03.781818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:03.795539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '835e8daa85c749b2aed01f1daec14da6', 'request_id': 'req-909d7d15-4feb-49ae-878c-363e487f2efd'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.804030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '835e8daa85c749b2aed01f1daec14da6', 'request_id': 'req-909d7d15-4feb-49ae-878c-363e487f2efd'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.811390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '835e8daa85c749b2aed01f1daec14da6', 'request_id': 'req-909d7d15-4feb-49ae-878c-363e487f2efd'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.829952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] The token cache is being invalidate because project 835e8daa85c749b2aed01f1daec14da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:03.830271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.831048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-909d7d15-4feb-49ae-878c-363e487f2efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.832825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1095/2167] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:03 2022] DELETE /identity/v3/projects/835e8daa85c749b2aed01f1daec14da6 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:03.836199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc08edc0e354ea0b8e41a2d81f3d9d4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.837903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4deed2-b075-4087-8a56-d13fabb1c688 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:03.838192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4deed2-b075-4087-8a56-d13fabb1c688 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:03.838530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4deed2-b075-4087-8a56-d13fabb1c688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:03.842978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc08edc0e354ea0b8e41a2d81f3d9d4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.851389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc08edc0e354ea0b8e41a2d81f3d9d4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.852065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc08edc0e354ea0b8e41a2d81f3d9d4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.852618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff15d29f-7ddd-4cca-823e-f5ddbca22c06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc08edc0e354ea0b8e41a2d81f3d9d4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:03.857833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4a4deed2-b075-4087-8a56-d13fabb1c688 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:03.859081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4a4deed2-b075-4087-8a56-d13fabb1c688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:03.882704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1073/2168] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:27:03 2022] DELETE /identity/v3/users/bdc08edc0e354ea0b8e41a2d81f3d9d4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:03.925308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1096/2169] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:27:03.934515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093d09-a454-4c3e-a44c-c49675ad2067 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:03.934945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093d09-a454-4c3e-a44c-c49675ad2067 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:03.935203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093d09-a454-4c3e-a44c-c49675ad2067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:03.959627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-f4093d09-a454-4c3e-a44c-c49675ad2067 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:03.961129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f4093d09-a454-4c3e-a44c-c49675ad2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.046081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1074/2170] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:04.050669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4deed2-b075-4087-8a56-d13fabb1c688 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.060363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4deed2-b075-4087-8a56-d13fabb1c688 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.068111 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248ae2-d78d-4ed4-bb29-6785cbe1eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.068826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248ae2-d78d-4ed4-bb29-6785cbe1eb31 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.069082 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248ae2-d78d-4ed4-bb29-6785cbe1eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.069365 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95248ae2-d78d-4ed4-bb29-6785cbe1eb31 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.070768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95248ae2-d78d-4ed4-bb29-6785cbe1eb31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:27:04.070926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4093d09-a454-4c3e-a44c-c49675ad2067 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.071026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95248ae2-d78d-4ed4-bb29-6785cbe1eb31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.073452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f4093d09-a454-4c3e-a44c-c49675ad2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.073578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95248ae2-d78d-4ed4-bb29-6785cbe1eb31 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.086473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1097/2171] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:27:04.089461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248ae2-d78d-4ed4-bb29-6785cbe1eb31 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.100522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95248ae2-d78d-4ed4-bb29-6785cbe1eb31 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.106197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee671e-a953-40c5-ac08-85d0f4b1dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.107128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee671e-a953-40c5-ac08-85d0f4b1dd4e admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.107749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee671e-a953-40c5-ac08-85d0f4b1dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.107866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee671e-a953-40c5-ac08-85d0f4b1dd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.108658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee671e-a953-40c5-ac08-85d0f4b1dd4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.111180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee671e-a953-40c5-ac08-85d0f4b1dd4e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.142427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4093d09-a454-4c3e-a44c-c49675ad2067 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.146357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1098/2172] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:04 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:27:04.146357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee671e-a953-40c5-ac08-85d0f4b1dd4e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.146357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-85ee671e-a953-40c5-ac08-85d0f4b1dd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.195278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d7817-cffa-45f0-94bc-427a4f5d16b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.196279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d7817-cffa-45f0-94bc-427a4f5d16b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.196718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d7817-cffa-45f0-94bc-427a4f5d16b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.197160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d7817-cffa-45f0-94bc-427a4f5d16b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.199014 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e56d7817-cffa-45f0-94bc-427a4f5d16b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.209041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee671e-a953-40c5-ac08-85d0f4b1dd4e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.214522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.218787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.218787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.218787 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] PATH_INFO: `/v3/projects/d3610d0185cf40548de23d406b26a421` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.220278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3610d0185cf40548de23d406b26a421)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.222356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.268318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d7817-cffa-45f0-94bc-427a4f5d16b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.270934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d7817-cffa-45f0-94bc-427a4f5d16b2 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.274800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3610d0185cf40548de23d406b26a421', 'request_id': 'req-51ec55c4-e7a0-4747-b884-4301f00ccec8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:04.281334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1075/2173] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:27:04.282138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d7817-cffa-45f0-94bc-427a4f5d16b2 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.282873 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3610d0185cf40548de23d406b26a421', 'request_id': 'req-51ec55c4-e7a0-4747-b884-4301f00ccec8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:04.290691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3610d0185cf40548de23d406b26a421', 'request_id': 'req-51ec55c4-e7a0-4747-b884-4301f00ccec8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:04.292646 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d7817-cffa-45f0-94bc-427a4f5d16b2 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.302805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] The token cache is being invalidate because project d3610d0185cf40548de23d406b26a421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:04.303113 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:04.303948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-51ec55c4-e7a0-4747-b884-4301f00ccec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:04.306196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1099/2174] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:04 2022] DELETE /identity/v3/projects/d3610d0185cf40548de23d406b26a421 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:04.310925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df3998-df7b-44c1-b5be-1aeb27cb5cf9 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.311218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df3998-df7b-44c1-b5be-1aeb27cb5cf9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.311559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df3998-df7b-44c1-b5be-1aeb27cb5cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.337136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a7df3998-df7b-44c1-b5be-1aeb27cb5cf9 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:04.338901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a7df3998-df7b-44c1-b5be-1aeb27cb5cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.364597 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a946c-0daa-44e1-ac3e-16fc75706c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.365372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a946c-0daa-44e1-ac3e-16fc75706c8d admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.365713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a946c-0daa-44e1-ac3e-16fc75706c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.366054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a946c-0daa-44e1-ac3e-16fc75706c8d admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.366836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a946c-0daa-44e1-ac3e-16fc75706c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.368873 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a946c-0daa-44e1-ac3e-16fc75706c8d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.390519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1076/2175] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:04 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:04.393492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a946c-0daa-44e1-ac3e-16fc75706c8d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.396273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9e2a946c-0daa-44e1-ac3e-16fc75706c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.409739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1100/2176] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:27:04.410024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a946c-0daa-44e1-ac3e-16fc75706c8d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.417738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2686e-dd8e-4ed0-abf6-7bb9b08c2930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.418498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2686e-dd8e-4ed0-abf6-7bb9b08c2930 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.418659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09896e-ebe6-4fac-a361-cf2d7f7f545c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.418949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2686e-dd8e-4ed0-abf6-7bb9b08c2930 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.419098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09896e-ebe6-4fac-a361-cf2d7f7f545c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.419191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a2686e-dd8e-4ed0-abf6-7bb9b08c2930 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.419488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09896e-ebe6-4fac-a361-cf2d7f7f545c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.420001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2686e-dd8e-4ed0-abf6-7bb9b08c2930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.421694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a2686e-dd8e-4ed0-abf6-7bb9b08c2930 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.432376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1077/2177] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:04.436538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2686e-dd8e-4ed0-abf6-7bb9b08c2930 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.442015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-bd09896e-ebe6-4fac-a361-cf2d7f7f545c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:04.443488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bd09896e-ebe6-4fac-a361-cf2d7f7f545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.446955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a2686e-dd8e-4ed0-abf6-7bb9b08c2930 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.452317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1101/2178] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:04.452473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1a425-649d-46a0-ac69-ecf3e036bfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.453332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1a425-649d-46a0-ac69-ecf3e036bfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.453605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1a425-649d-46a0-ac69-ecf3e036bfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.453928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1a425-649d-46a0-ac69-ecf3e036bfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.454739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1a425-649d-46a0-ac69-ecf3e036bfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.456765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1a425-649d-46a0-ac69-ecf3e036bfa6 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.456882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09896e-ebe6-4fac-a361-cf2d7f7f545c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.466573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09896e-ebe6-4fac-a361-cf2d7f7f545c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.468217 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1078/2179] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:04.471444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1cc12-5423-4d06-a53e-534e317fa07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.472696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1cc12-5423-4d06-a53e-534e317fa07c admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.472809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1a425-649d-46a0-ac69-ecf3e036bfa6 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.472978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1cc12-5423-4d06-a53e-534e317fa07c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.473259 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1cc12-5423-4d06-a53e-534e317fa07c admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.475822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1cc12-5423-4d06-a53e-534e317fa07c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:27:04.475822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1cc12-5423-4d06-a53e-534e317fa07c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.478288 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1cc12-5423-4d06-a53e-534e317fa07c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.485158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1a425-649d-46a0-ac69-ecf3e036bfa6 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.489189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1102/2180] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:27:04.490452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12573e01-ee57-4d18-9f27-404426a81f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.491335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573e01-ee57-4d18-9f27-404426a81f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.491640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573e01-ee57-4d18-9f27-404426a81f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.491958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12573e01-ee57-4d18-9f27-404426a81f4c admin admin] PATH_INFO: `/v3/projects/4d829832a67942c89c33adf4eea0df20/users/d01c35b046284938a73d4404234c1f24/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.493429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1cc12-5423-4d06-a53e-534e317fa07c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.504385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1cc12-5423-4d06-a53e-534e317fa07c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.507609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573e01-ee57-4d18-9f27-404426a81f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d829832a67942c89c33adf4eea0df20, user_id=d01c35b046284938a73d4404234c1f24, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.512978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12573e01-ee57-4d18-9f27-404426a81f4c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.515007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6375cd-59f4-4baa-bc80-f52bfe19cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.515843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6375cd-59f4-4baa-bc80-f52bfe19cedd admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.516227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6375cd-59f4-4baa-bc80-f52bfe19cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.516542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6375cd-59f4-4baa-bc80-f52bfe19cedd admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.517516 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6375cd-59f4-4baa-bc80-f52bfe19cedd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.520052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6375cd-59f4-4baa-bc80-f52bfe19cedd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.529212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1079/2181] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:04 2022] PUT /identity/v3/projects/4d829832a67942c89c33adf4eea0df20/users/d01c35b046284938a73d4404234c1f24/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:04.533884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d708af8-6f02-48c5-bc7b-92873162de1d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.534747 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d708af8-6f02-48c5-bc7b-92873162de1d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.535028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d708af8-6f02-48c5-bc7b-92873162de1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.558727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1103/2182] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:04 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:27:04.558727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6375cd-59f4-4baa-bc80-f52bfe19cedd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.558918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-8d708af8-6f02-48c5-bc7b-92873162de1d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:04.567911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8d708af8-6f02-48c5-bc7b-92873162de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.633706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6375cd-59f4-4baa-bc80-f52bfe19cedd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.639353 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fec54-3a1e-41d7-8a51-8c57c0064e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.640024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fec54-3a1e-41d7-8a51-8c57c0064e23 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.640426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fec54-3a1e-41d7-8a51-8c57c0064e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.640771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fec54-3a1e-41d7-8a51-8c57c0064e23 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.641434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fec54-3a1e-41d7-8a51-8c57c0064e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.643371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fec54-3a1e-41d7-8a51-8c57c0064e23 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.645057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1080/2183] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:27:04.660181 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d708af8-6f02-48c5-bc7b-92873162de1d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.665704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8d708af8-6f02-48c5-bc7b-92873162de1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.668908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1104/2184] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:04 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:04.670820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fec54-3a1e-41d7-8a51-8c57c0064e23 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.681638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fec54-3a1e-41d7-8a51-8c57c0064e23 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.687332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24c3e2-1280-43c4-a07b-48a7c22d9320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.688785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24c3e2-1280-43c4-a07b-48a7c22d9320 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.689209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24c3e2-1280-43c4-a07b-48a7c22d9320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.689721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24c3e2-1280-43c4-a07b-48a7c22d9320 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.691715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24c3e2-1280-43c4-a07b-48a7c22d9320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.694368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24c3e2-1280-43c4-a07b-48a7c22d9320 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.708701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1105/2185] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:27:04.712570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24c3e2-1280-43c4-a07b-48a7c22d9320 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.723312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24c3e2-1280-43c4-a07b-48a7c22d9320 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.729278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417de95-6978-4cce-aeda-150699923b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.730094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417de95-6978-4cce-aeda-150699923b3e admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.730490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417de95-6978-4cce-aeda-150699923b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.730840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417de95-6978-4cce-aeda-150699923b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.731630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417de95-6978-4cce-aeda-150699923b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.733325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417de95-6978-4cce-aeda-150699923b3e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.736419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d708af8-6f02-48c5-bc7b-92873162de1d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.740814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb565e97-d28b-4d89-93b9-347c55cb91e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.741495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565e97-d28b-4d89-93b9-347c55cb91e0 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.741771 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565e97-d28b-4d89-93b9-347c55cb91e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.742049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb565e97-d28b-4d89-93b9-347c55cb91e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.746517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1106/2186] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:27:04.750581 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417de95-6978-4cce-aeda-150699923b3e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.751732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb565e97-d28b-4d89-93b9-347c55cb91e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.753370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb565e97-d28b-4d89-93b9-347c55cb91e0 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.760078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417de95-6978-4cce-aeda-150699923b3e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:04.763123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1081/2187] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:04.764566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580181b-3fa5-4ecf-8a3f-1d5ec76b82a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:04.765435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580181b-3fa5-4ecf-8a3f-1d5ec76b82a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.765712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580181b-3fa5-4ecf-8a3f-1d5ec76b82a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.765978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580181b-3fa5-4ecf-8a3f-1d5ec76b82a6 admin admin] PATH_INFO: `/v3/projects/085c39e53cf24a47aba6a5708a4de39b/users/5b4e4bb2e7b441d28f3d98c442573d18/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.780864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580181b-3fa5-4ecf-8a3f-1d5ec76b82a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085c39e53cf24a47aba6a5708a4de39b, user_id=5b4e4bb2e7b441d28f3d98c442573d18, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:04.783535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580181b-3fa5-4ecf-8a3f-1d5ec76b82a6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:04.796636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1107/2188] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:04 2022] PUT /identity/v3/projects/085c39e53cf24a47aba6a5708a4de39b/users/5b4e4bb2e7b441d28f3d98c442573d18/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:04.807909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ae5b1-cce8-470b-9da6-feca468a1c63 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:04.808202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ae5b1-cce8-470b-9da6-feca468a1c63 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:04.808486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ae5b1-cce8-470b-9da6-feca468a1c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:04.834952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-258ae5b1-cce8-470b-9da6-feca468a1c63 None None] MFA Rules not processed for user `5b4e4bb2e7b441d28f3d98c442573d18`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:04.836257 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-258ae5b1-cce8-470b-9da6-feca468a1c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:04.905251 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1082/2189] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:04.917237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580181b-3fa5-4ecf-8a3f-1d5ec76b82a6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:04.919518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6580181b-3fa5-4ecf-8a3f-1d5ec76b82a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:05.025584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580181b-3fa5-4ecf-8a3f-1d5ec76b82a6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:05.036313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb292-1710-482f-8faf-3112b90fdd87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:05.037383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb292-1710-482f-8faf-3112b90fdd87 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:05.038400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb292-1710-482f-8faf-3112b90fdd87 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:05.038868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb292-1710-482f-8faf-3112b90fdd87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:05.048341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb292-1710-482f-8faf-3112b90fdd87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:05.050709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb292-1710-482f-8faf-3112b90fdd87 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:05.061020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1108/2190] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:27:05.473482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7bb1d-6b9a-4659-a644-eacdd493f9dd None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:05.473935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7bb1d-6b9a-4659-a644-eacdd493f9dd None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:05.474042 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7bb1d-6b9a-4659-a644-eacdd493f9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:05.505432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-f2d7bb1d-6b9a-4659-a644-eacdd493f9dd None None] MFA Rules not processed for user `d01c35b046284938a73d4404234c1f24`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:05.506684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f2d7bb1d-6b9a-4659-a644-eacdd493f9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:05.571594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1083/2191] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:05.582638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb292-1710-482f-8faf-3112b90fdd87 service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:05.584171 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6d8cb292-1710-482f-8faf-3112b90fdd87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:05.641090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb292-1710-482f-8faf-3112b90fdd87 service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:05.646557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36c79b-3489-4842-b319-7386bb6be7d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:05.647237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c79b-3489-4842-b319-7386bb6be7d8 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:05.647561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c79b-3489-4842-b319-7386bb6be7d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:05.647861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36c79b-3489-4842-b319-7386bb6be7d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:05.661497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36c79b-3489-4842-b319-7386bb6be7d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:05.663006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36c79b-3489-4842-b319-7386bb6be7d8 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:05.672084 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1109/2192] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:08.054487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6797d7-d155-43a7-991a-1107e9228dda None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:08.055041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6797d7-d155-43a7-991a-1107e9228dda None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:08.055294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6797d7-d155-43a7-991a-1107e9228dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:08.075062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2e6797d7-d155-43a7-991a-1107e9228dda None None] MFA Rules not processed for user `d01c35b046284938a73d4404234c1f24`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:08.076274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2e6797d7-d155-43a7-991a-1107e9228dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:08.083219 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1084/2193] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:08.833024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36c79b-3489-4842-b319-7386bb6be7d8 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:08.893796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36c79b-3489-4842-b319-7386bb6be7d8 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:08.898283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:08.899144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:08.899427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:08.899699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] PATH_INFO: `/v3/users/5b4e4bb2e7b441d28f3d98c442573d18` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:08.901128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b4e4bb2e7b441d28f3d98c442573d18)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:08.903098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:08.948293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b4e4bb2e7b441d28f3d98c442573d18'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:08.954836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b4e4bb2e7b441d28f3d98c442573d18'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:08.962495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b4e4bb2e7b441d28f3d98c442573d18'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:08.963106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b4e4bb2e7b441d28f3d98c442573d18'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:08.963708 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b4e4bb2e7b441d28f3d98c442573d18'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:08.984509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1110/2194] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:27:08 2022] DELETE /identity/v3/users/5b4e4bb2e7b441d28f3d98c442573d18 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:08.989859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600d8a3-595f-401c-81a6-746341ac4e67 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:08.989859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600d8a3-595f-401c-81a6-746341ac4e67 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:08.990122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600d8a3-595f-401c-81a6-746341ac4e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.007133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5600d8a3-595f-401c-81a6-746341ac4e67 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:09.008362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5600d8a3-595f-401c-81a6-746341ac4e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:09.067447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1085/2195] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:09.079308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:09.080696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:09.144405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489d79a-c8ca-460d-bf9f-4f0c5e147e42 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:09.148795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cd53bd-097c-4281-ae74-02982b9c83bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:09.149455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd53bd-097c-4281-ae74-02982b9c83bd service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.149765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd53bd-097c-4281-ae74-02982b9c83bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.150042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd53bd-097c-4281-ae74-02982b9c83bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.161579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd53bd-097c-4281-ae74-02982b9c83bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:09.163107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cd53bd-097c-4281-ae74-02982b9c83bd service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:09.172574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1111/2196] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:09.437062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600d8a3-595f-401c-81a6-746341ac4e67 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:09.439228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5600d8a3-595f-401c-81a6-746341ac4e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:09.452379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600d8a3-595f-401c-81a6-746341ac4e67 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:09.457762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:09.458559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.458756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.459013 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] PATH_INFO: `/v3/projects/085c39e53cf24a47aba6a5708a4de39b` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.460225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=085c39e53cf24a47aba6a5708a4de39b)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:09.462223 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:09.510740 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085c39e53cf24a47aba6a5708a4de39b', 'request_id': 'req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:09.516630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085c39e53cf24a47aba6a5708a4de39b', 'request_id': 'req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:09.522932 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085c39e53cf24a47aba6a5708a4de39b', 'request_id': 'req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:09.536257 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] The token cache is being invalidate because project 085c39e53cf24a47aba6a5708a4de39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:09.536540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:09.537147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-07a4ca46-ea41-4fd6-bb9f-3dbadf54fe68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:09.538791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1086/2197] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:09 2022] DELETE /identity/v3/projects/085c39e53cf24a47aba6a5708a4de39b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:09.543646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0501ce-c67a-4586-8873-be706b26dfce None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.543911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0501ce-c67a-4586-8873-be706b26dfce None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.544185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0501ce-c67a-4586-8873-be706b26dfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.562380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0d0501ce-c67a-4586-8873-be706b26dfce None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:09.563483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0d0501ce-c67a-4586-8873-be706b26dfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:09.622891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1112/2198] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:09.631026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57da6a2-cd19-4fe4-9d2b-89c75a0512ea None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.631315 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57da6a2-cd19-4fe4-9d2b-89c75a0512ea None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.631592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57da6a2-cd19-4fe4-9d2b-89c75a0512ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.650172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b57da6a2-cd19-4fe4-9d2b-89c75a0512ea None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:09.651655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b57da6a2-cd19-4fe4-9d2b-89c75a0512ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:09.660917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1087/2199] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:09.666009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0501ce-c67a-4586-8873-be706b26dfce None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:09.676371 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0501ce-c67a-4586-8873-be706b26dfce None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:09.680902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce80d1-7fc0-45fe-b65d-1c748a05c768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:09.681551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce80d1-7fc0-45fe-b65d-1c748a05c768 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.681831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce80d1-7fc0-45fe-b65d-1c748a05c768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.682102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce80d1-7fc0-45fe-b65d-1c748a05c768 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.682850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce80d1-7fc0-45fe-b65d-1c748a05c768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:27:09.683154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce80d1-7fc0-45fe-b65d-1c748a05c768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:09.684732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce80d1-7fc0-45fe-b65d-1c748a05c768 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:09.699859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1113/2200] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:27:09.701540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57da6a2-cd19-4fe4-9d2b-89c75a0512ea None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:09.710874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57da6a2-cd19-4fe4-9d2b-89c75a0512ea None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:09.717709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8827c-d51e-4da2-95fe-ad4ac0872c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:09.718415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8827c-d51e-4da2-95fe-ad4ac0872c7f admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.718700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8827c-d51e-4da2-95fe-ad4ac0872c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.718976 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8827c-d51e-4da2-95fe-ad4ac0872c7f admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.719689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8827c-d51e-4da2-95fe-ad4ac0872c7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:09.722086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8827c-d51e-4da2-95fe-ad4ac0872c7f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:09.751531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1088/2201] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:09 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:27:09.752963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce80d1-7fc0-45fe-b65d-1c748a05c768 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:09.762728 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce80d1-7fc0-45fe-b65d-1c748a05c768 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:09.819885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db07f7a-9080-4bc5-9bad-a132bc6950bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:09.820468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db07f7a-9080-4bc5-9bad-a132bc6950bd admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.820754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db07f7a-9080-4bc5-9bad-a132bc6950bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.821032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db07f7a-9080-4bc5-9bad-a132bc6950bd admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.821722 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db07f7a-9080-4bc5-9bad-a132bc6950bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:09.823687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db07f7a-9080-4bc5-9bad-a132bc6950bd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:09.846295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1114/2202] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:09 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:27:09.854064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8827c-d51e-4da2-95fe-ad4ac0872c7f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:09.865163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8827c-d51e-4da2-95fe-ad4ac0872c7f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:09.869807 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ec1f5-9f3f-4edb-a7d6-d57e5bb75a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:09.870496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ec1f5-9f3f-4edb-a7d6-d57e5bb75a08 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.870783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ec1f5-9f3f-4edb-a7d6-d57e5bb75a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.871060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ec1f5-9f3f-4edb-a7d6-d57e5bb75a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.871785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ec1f5-9f3f-4edb-a7d6-d57e5bb75a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:09.873363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ec1f5-9f3f-4edb-a7d6-d57e5bb75a08 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:09.883293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1089/2203] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:09.887216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db07f7a-9080-4bc5-9bad-a132bc6950bd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:09.896983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db07f7a-9080-4bc5-9bad-a132bc6950bd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:09.902021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98b6d9-6759-4fa1-ac9e-b996eaf4ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:09.903031 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98b6d9-6759-4fa1-ac9e-b996eaf4ce78 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.903445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98b6d9-6759-4fa1-ac9e-b996eaf4ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.903726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98b6d9-6759-4fa1-ac9e-b996eaf4ce78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.904632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98b6d9-6759-4fa1-ac9e-b996eaf4ce78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:09.908398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98b6d9-6759-4fa1-ac9e-b996eaf4ce78 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:09.918538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1115/2204] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:09.922458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ec1f5-9f3f-4edb-a7d6-d57e5bb75a08 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:09.933164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ec1f5-9f3f-4edb-a7d6-d57e5bb75a08 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:09.937728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc1ab-6481-4289-99da-d8f3304cae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:09.938651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc1ab-6481-4289-99da-d8f3304cae4b admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.938935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc1ab-6481-4289-99da-d8f3304cae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.939210 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681dc1ab-6481-4289-99da-d8f3304cae4b admin admin] PATH_INFO: `/v3/projects/202604fa38d746519370f24dfb20b1be/users/4bf603ba142e42aabc714257bf8465e8/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:09.953104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dc1ab-6481-4289-99da-d8f3304cae4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=202604fa38d746519370f24dfb20b1be, user_id=4bf603ba142e42aabc714257bf8465e8, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:09.955801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681dc1ab-6481-4289-99da-d8f3304cae4b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:09.967778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1090/2205] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:09 2022] PUT /identity/v3/projects/202604fa38d746519370f24dfb20b1be/users/4bf603ba142e42aabc714257bf8465e8/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:09.978946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385840c-3f25-4062-8244-1e3b43aaf0a8 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:09.979239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385840c-3f25-4062-8244-1e3b43aaf0a8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:09.979524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385840c-3f25-4062-8244-1e3b43aaf0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.005764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a385840c-3f25-4062-8244-1e3b43aaf0a8 None None] MFA Rules not processed for user `4bf603ba142e42aabc714257bf8465e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:10.007201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a385840c-3f25-4062-8244-1e3b43aaf0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:10.072972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1116/2206] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:10.077339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc1ab-6481-4289-99da-d8f3304cae4b admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.138213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681dc1ab-6481-4289-99da-d8f3304cae4b admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.143001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aacbc4-68a0-4b0e-a2f2-2e365763dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.144228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aacbc4-68a0-4b0e-a2f2-2e365763dd2a admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.144512 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aacbc4-68a0-4b0e-a2f2-2e365763dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.144789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aacbc4-68a0-4b0e-a2f2-2e365763dd2a admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.145475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aacbc4-68a0-4b0e-a2f2-2e365763dd2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.147450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aacbc4-68a0-4b0e-a2f2-2e365763dd2a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.174385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1091/2207] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:10 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:10.178434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385840c-3f25-4062-8244-1e3b43aaf0a8 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.190961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385840c-3f25-4062-8244-1e3b43aaf0a8 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.224155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aacbc4-68a0-4b0e-a2f2-2e365763dd2a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.226031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e4aacbc4-68a0-4b0e-a2f2-2e365763dd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:10.248174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0d3cc-0049-4520-9747-09f11692f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.248851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0d3cc-0049-4520-9747-09f11692f3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.249138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0d3cc-0049-4520-9747-09f11692f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.249412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0d3cc-0049-4520-9747-09f11692f3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.250106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0d3cc-0049-4520-9747-09f11692f3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.252054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0d3cc-0049-4520-9747-09f11692f3a0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.271778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1117/2208] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:10 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:10.276078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0d3cc-0049-4520-9747-09f11692f3a0 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.286642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0d3cc-0049-4520-9747-09f11692f3a0 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.292244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff81a4f-5cbc-49a6-afa5-14955b056a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.293098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81a4f-5cbc-49a6-afa5-14955b056a09 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.293457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81a4f-5cbc-49a6-afa5-14955b056a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.293804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff81a4f-5cbc-49a6-afa5-14955b056a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.294131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aacbc4-68a0-4b0e-a2f2-2e365763dd2a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.294744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff81a4f-5cbc-49a6-afa5-14955b056a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.296407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff81a4f-5cbc-49a6-afa5-14955b056a09 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.299498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.300479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.300936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.301280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] PATH_INFO: `/v3/users/e0a1fd53a4654a0ebcdfbe1d6f2012a5` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.303157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a1fd53a4654a0ebcdfbe1d6f2012a5)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.305141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.307396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1118/2209] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:27:10.311738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff81a4f-5cbc-49a6-afa5-14955b056a09 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.322875 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff81a4f-5cbc-49a6-afa5-14955b056a09 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.328189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cef5bc-0740-4e19-b7c0-713f3f20d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.329018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cef5bc-0740-4e19-b7c0-713f3f20d4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.329299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cef5bc-0740-4e19-b7c0-713f3f20d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.329572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cef5bc-0740-4e19-b7c0-713f3f20d4b9 admin admin] PATH_INFO: `/v3/projects/b774d401c34743dca809e81e1954411d/users/d5c986423e4e4347b5717a1301967e14/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.348507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cef5bc-0740-4e19-b7c0-713f3f20d4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b774d401c34743dca809e81e1954411d, user_id=d5c986423e4e4347b5717a1301967e14, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.351445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cef5bc-0740-4e19-b7c0-713f3f20d4b9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.354779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a1fd53a4654a0ebcdfbe1d6f2012a5'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:10.361866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a1fd53a4654a0ebcdfbe1d6f2012a5'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:10.363753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1119/2210] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:10 2022] PUT /identity/v3/projects/b774d401c34743dca809e81e1954411d/users/d5c986423e4e4347b5717a1301967e14/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:10.367651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cef5bc-0740-4e19-b7c0-713f3f20d4b9 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.372246 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a1fd53a4654a0ebcdfbe1d6f2012a5'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:10.373177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a1fd53a4654a0ebcdfbe1d6f2012a5'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:10.373832 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1862f2c5-b527-4c87-8208-f0bcbb44965a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a1fd53a4654a0ebcdfbe1d6f2012a5'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:10.392980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1092/2211] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:27:10 2022] DELETE /identity/v3/users/e0a1fd53a4654a0ebcdfbe1d6f2012a5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:10.398236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a48a57-c643-401e-ba67-e6f957aa4ce7 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.398944 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a48a57-c643-401e-ba67-e6f957aa4ce7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.399511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a48a57-c643-401e-ba67-e6f957aa4ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.420566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-85a48a57-c643-401e-ba67-e6f957aa4ce7 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:10.421781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-85a48a57-c643-401e-ba67-e6f957aa4ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:10.431507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cef5bc-0740-4e19-b7c0-713f3f20d4b9 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.480225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1093/2212] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:27:10.490004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a48a57-c643-401e-ba67-e6f957aa4ce7 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.490484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9afbc-2e79-4812-85c6-438df1c45669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.491158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9afbc-2e79-4812-85c6-438df1c45669 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.491442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9afbc-2e79-4812-85c6-438df1c45669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.491554 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-85a48a57-c643-401e-ba67-e6f957aa4ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:10.491719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9afbc-2e79-4812-85c6-438df1c45669 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.492446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9afbc-2e79-4812-85c6-438df1c45669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.494063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9afbc-2e79-4812-85c6-438df1c45669 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.504741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1120/2213] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:27:10.509091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9afbc-2e79-4812-85c6-438df1c45669 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.511519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bfe9afbc-2e79-4812-85c6-438df1c45669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:10.528585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9afbc-2e79-4812-85c6-438df1c45669 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.535085 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ba9db-9488-40a0-9501-f325180cd0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.536023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ba9db-9488-40a0-9501-f325180cd0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.536312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ba9db-9488-40a0-9501-f325180cd0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.536592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ba9db-9488-40a0-9501-f325180cd0b4 admin admin] PATH_INFO: `/v3/projects/b774d401c34743dca809e81e1954411d/users/d5c986423e4e4347b5717a1301967e14/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.538640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ba9db-9488-40a0-9501-f325180cd0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b774d401c34743dca809e81e1954411d, user_id=d5c986423e4e4347b5717a1301967e14, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.541341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ba9db-9488-40a0-9501-f325180cd0b4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.552402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1121/2214] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:10 2022] PUT /identity/v3/projects/b774d401c34743dca809e81e1954411d/users/d5c986423e4e4347b5717a1301967e14/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:10.553184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a48a57-c643-401e-ba67-e6f957aa4ce7 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.564130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967edd5e-4964-436f-ad8f-c75164244b0a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.564422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967edd5e-4964-436f-ad8f-c75164244b0a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.564711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967edd5e-4964-436f-ad8f-c75164244b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.594019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-967edd5e-4964-436f-ad8f-c75164244b0a None None] MFA Rules not processed for user `d5c986423e4e4347b5717a1301967e14`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:10.595255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-967edd5e-4964-436f-ad8f-c75164244b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:10.609028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469876c-964b-42dd-996c-fca3ccfd4610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.609684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469876c-964b-42dd-996c-fca3ccfd4610 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.609965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469876c-964b-42dd-996c-fca3ccfd4610 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.610240 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469876c-964b-42dd-996c-fca3ccfd4610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.664805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1122/2215] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:27:10.673651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469876c-964b-42dd-996c-fca3ccfd4610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.675431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4469876c-964b-42dd-996c-fca3ccfd4610 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.676278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967edd5e-4964-436f-ad8f-c75164244b0a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.677738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-967edd5e-4964-436f-ad8f-c75164244b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:10.684750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1094/2216] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:27:10.739326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967edd5e-4964-436f-ad8f-c75164244b0a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.743383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d586d-ffce-480d-a2ca-1e01345afc07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.744042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d586d-ffce-480d-a2ca-1e01345afc07 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.744326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d586d-ffce-480d-a2ca-1e01345afc07 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.744601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d586d-ffce-480d-a2ca-1e01345afc07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.754281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d586d-ffce-480d-a2ca-1e01345afc07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.756195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d586d-ffce-480d-a2ca-1e01345afc07 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.766024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1123/2217] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:27:10.854913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469876c-964b-42dd-996c-fca3ccfd4610 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:10.865105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469876c-964b-42dd-996c-fca3ccfd4610 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:10.868904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390847a1-0328-444e-b28f-1d638e4b4ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:10.869662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390847a1-0328-444e-b28f-1d638e4b4ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:10.870012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390847a1-0328-444e-b28f-1d638e4b4ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:10.870395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390847a1-0328-444e-b28f-1d638e4b4ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:10.872567 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-390847a1-0328-444e-b28f-1d638e4b4ff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:10.938937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390847a1-0328-444e-b28f-1d638e4b4ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:10.940425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390847a1-0328-444e-b28f-1d638e4b4ff7 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:10.949400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1095/2218] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:11.023738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d586d-ffce-480d-a2ca-1e01345afc07 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:11.029053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b29d586d-ffce-480d-a2ca-1e01345afc07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:11.044700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d586d-ffce-480d-a2ca-1e01345afc07 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:11.051123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:11.052936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:11.053377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:11.053960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] PATH_INFO: `/v3/projects/05cdc311c2ce478388a9f495b27a48d2` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:11.055770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05cdc311c2ce478388a9f495b27a48d2)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:11.058563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:11.125424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05cdc311c2ce478388a9f495b27a48d2', 'request_id': 'req-57846014-0e00-4c08-b8c9-ff94ac9da3b0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.133445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05cdc311c2ce478388a9f495b27a48d2', 'request_id': 'req-57846014-0e00-4c08-b8c9-ff94ac9da3b0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.139688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05cdc311c2ce478388a9f495b27a48d2', 'request_id': 'req-57846014-0e00-4c08-b8c9-ff94ac9da3b0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.150737 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] The token cache is being invalidate because project 05cdc311c2ce478388a9f495b27a48d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:11.151050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.151696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.153230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1124/2219] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:11 2022] DELETE /identity/v3/projects/05cdc311c2ce478388a9f495b27a48d2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:11.157275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390847a1-0328-444e-b28f-1d638e4b4ff7 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:11.168491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390847a1-0328-444e-b28f-1d638e4b4ff7 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:11.224634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:11.225508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:11.225794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:11.226072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] PATH_INFO: `/v3/users/3f032c81e24f411bb19ae919cfada746` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:11.227299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f032c81e24f411bb19ae919cfada746)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:11.229238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:11.277468 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f032c81e24f411bb19ae919cfada746'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.285033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f032c81e24f411bb19ae919cfada746'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.292668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f032c81e24f411bb19ae919cfada746'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.293295 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f032c81e24f411bb19ae919cfada746'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.293887 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3c26f475-52b1-4341-8ea2-f44d517a3d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f032c81e24f411bb19ae919cfada746'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.310156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1096/2220] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:27:11 2022] DELETE /identity/v3/users/3f032c81e24f411bb19ae919cfada746 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:11.576032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:11.578380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:11.594164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57846014-0e00-4c08-b8c9-ff94ac9da3b0 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:11.655702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:11.657136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:11.657430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:11.657723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] PATH_INFO: `/v3/projects/462285053ff049d19e29aee4865b5811` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:11.658983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=462285053ff049d19e29aee4865b5811)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:11.660878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:11.710757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '462285053ff049d19e29aee4865b5811', 'request_id': 'req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.717869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '462285053ff049d19e29aee4865b5811', 'request_id': 'req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.724038 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '462285053ff049d19e29aee4865b5811', 'request_id': 'req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.736078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] The token cache is being invalidate because project 462285053ff049d19e29aee4865b5811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:11.736377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.737582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-fd4578b1-b14f-4c48-8668-e1bc7ab1d287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:11.739596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1125/2221] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:11 2022] DELETE /identity/v3/projects/462285053ff049d19e29aee4865b5811 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:11.745659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b788-103d-4bda-8976-363b3259b78e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:11.745956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b788-103d-4bda-8976-363b3259b78e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:11.746239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18b788-103d-4bda-8976-363b3259b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:11.765806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-1a18b788-103d-4bda-8976-363b3259b78e None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:11.767075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-1a18b788-103d-4bda-8976-363b3259b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:11.824965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1097/2222] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:11.834613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819321a-9abb-43c7-9266-b22cb057aeaf None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:11.834911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819321a-9abb-43c7-9266-b22cb057aeaf None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:11.835197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819321a-9abb-43c7-9266-b22cb057aeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:11.856259 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5819321a-9abb-43c7-9266-b22cb057aeaf None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:11.857388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5819321a-9abb-43c7-9266-b22cb057aeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:11.865603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1126/2223] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:11.869609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18b788-103d-4bda-8976-363b3259b78e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:11.879601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18b788-103d-4bda-8976-363b3259b78e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:11.884456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50857-f52d-4e68-98d4-504c7a25b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:11.885245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50857-f52d-4e68-98d4-504c7a25b194 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:11.885535 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50857-f52d-4e68-98d4-504c7a25b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:11.885813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50857-f52d-4e68-98d4-504c7a25b194 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:11.886588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50857-f52d-4e68-98d4-504c7a25b194 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:27:11.886896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50857-f52d-4e68-98d4-504c7a25b194 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:11.888508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50857-f52d-4e68-98d4-504c7a25b194 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:11.900618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1098/2224] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:27:11.905107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819321a-9abb-43c7-9266-b22cb057aeaf None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:11.914893 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819321a-9abb-43c7-9266-b22cb057aeaf None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:11.919689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b40de-3f4b-4006-b328-55bca8079ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:11.920346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b40de-3f4b-4006-b328-55bca8079ebe admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:11.920627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b40de-3f4b-4006-b328-55bca8079ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:11.921023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b40de-3f4b-4006-b328-55bca8079ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:11.921767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b40de-3f4b-4006-b328-55bca8079ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:11.923713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b40de-3f4b-4006-b328-55bca8079ebe admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:11.951800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1127/2225] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:11 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:11.958174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50857-f52d-4e68-98d4-504c7a25b194 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:11.968546 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50857-f52d-4e68-98d4-504c7a25b194 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:12.024863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb59eef-97b2-48cf-9c86-f1f778c2390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:12.025801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59eef-97b2-48cf-9c86-f1f778c2390a admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:12.026081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59eef-97b2-48cf-9c86-f1f778c2390a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:12.026387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59eef-97b2-48cf-9c86-f1f778c2390a admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:12.027075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb59eef-97b2-48cf-9c86-f1f778c2390a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:12.028984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb59eef-97b2-48cf-9c86-f1f778c2390a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:12.049595 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1099/2226] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:11 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:12.053976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b40de-3f4b-4006-b328-55bca8079ebe admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:12.064204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b40de-3f4b-4006-b328-55bca8079ebe admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:12.069397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838a196-ee7c-4f7f-befa-b284ac61353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:12.070149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838a196-ee7c-4f7f-befa-b284ac61353e admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:12.070559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838a196-ee7c-4f7f-befa-b284ac61353e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:12.070926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838a196-ee7c-4f7f-befa-b284ac61353e admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:12.071874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838a196-ee7c-4f7f-befa-b284ac61353e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:12.073874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838a196-ee7c-4f7f-befa-b284ac61353e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:12.084601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1128/2227] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:12.088811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb59eef-97b2-48cf-9c86-f1f778c2390a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:12.099196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb59eef-97b2-48cf-9c86-f1f778c2390a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:12.104169 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6d0ec-2465-4d48-b381-b343e06a8975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:12.105015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6d0ec-2465-4d48-b381-b343e06a8975 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:12.105369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6d0ec-2465-4d48-b381-b343e06a8975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:12.105710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6d0ec-2465-4d48-b381-b343e06a8975 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:12.107018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6d0ec-2465-4d48-b381-b343e06a8975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:12.108269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6d0ec-2465-4d48-b381-b343e06a8975 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:12.119656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1100/2228] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:12.124139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838a196-ee7c-4f7f-befa-b284ac61353e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:12.137422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838a196-ee7c-4f7f-befa-b284ac61353e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:12.155537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b660bd-c20d-46ac-810b-8f36ef3d8746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:12.157172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b660bd-c20d-46ac-810b-8f36ef3d8746 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:12.157525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b660bd-c20d-46ac-810b-8f36ef3d8746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:12.158396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b660bd-c20d-46ac-810b-8f36ef3d8746 admin admin] PATH_INFO: `/v3/projects/d2766647a48649ea81045f1faedad8ba/users/bf981673707d4447bffbb8e65d06ba51/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:12.175098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b660bd-c20d-46ac-810b-8f36ef3d8746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2766647a48649ea81045f1faedad8ba, user_id=bf981673707d4447bffbb8e65d06ba51, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:12.179020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b660bd-c20d-46ac-810b-8f36ef3d8746 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:12.209479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1129/2229] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:12 2022] PUT /identity/v3/projects/d2766647a48649ea81045f1faedad8ba/users/bf981673707d4447bffbb8e65d06ba51/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:12.222491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf723df-dfb5-4f2d-a682-f36d4209478a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:12.222980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf723df-dfb5-4f2d-a682-f36d4209478a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:12.223081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf723df-dfb5-4f2d-a682-f36d4209478a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:12.265977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-baf723df-dfb5-4f2d-a682-f36d4209478a None None] MFA Rules not processed for user `bf981673707d4447bffbb8e65d06ba51`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:12.268926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-baf723df-dfb5-4f2d-a682-f36d4209478a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:12.403963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1101/2230] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:12.412310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b660bd-c20d-46ac-810b-8f36ef3d8746 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:12.414244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-49b660bd-c20d-46ac-810b-8f36ef3d8746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:12.505961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b660bd-c20d-46ac-810b-8f36ef3d8746 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:12.510196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f52a7-fd80-4d6d-a3fa-4b1ef31e7a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:12.510885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f52a7-fd80-4d6d-a3fa-4b1ef31e7a60 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:12.511170 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f52a7-fd80-4d6d-a3fa-4b1ef31e7a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:12.511442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f52a7-fd80-4d6d-a3fa-4b1ef31e7a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:12.520814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f52a7-fd80-4d6d-a3fa-4b1ef31e7a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:12.522476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f52a7-fd80-4d6d-a3fa-4b1ef31e7a60 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:12.535378 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1130/2231] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:12.554817 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf723df-dfb5-4f2d-a682-f36d4209478a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:12.632076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf723df-dfb5-4f2d-a682-f36d4209478a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:12.636188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:12.637067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:12.637354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:12.637630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] PATH_INFO: `/v3/users/bf981673707d4447bffbb8e65d06ba51` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:12.638884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf981673707d4447bffbb8e65d06ba51)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:12.640806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:12.698119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf981673707d4447bffbb8e65d06ba51'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:12.705651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf981673707d4447bffbb8e65d06ba51'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:12.713956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf981673707d4447bffbb8e65d06ba51'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:12.718934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf981673707d4447bffbb8e65d06ba51'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:12.718934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf981673707d4447bffbb8e65d06ba51'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:12.733184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1102/2232] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:27:12 2022] DELETE /identity/v3/users/bf981673707d4447bffbb8e65d06ba51 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:12.737976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4e00a-0897-43e9-a4ac-c7c5d7c04fb3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:12.738296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4e00a-0897-43e9-a4ac-c7c5d7c04fb3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:12.738585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4e00a-0897-43e9-a4ac-c7c5d7c04fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:12.757023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-01f4e00a-0897-43e9-a4ac-c7c5d7c04fb3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:12.758317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-01f4e00a-0897-43e9-a4ac-c7c5d7c04fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:12.827730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1131/2233] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:12.838592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:12.840192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:12.907120 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269485bf-fde4-488a-8a09-47319a934712 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:12.911317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416fc2-63f7-41b7-a20a-c215c87bd9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:12.912008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416fc2-63f7-41b7-a20a-c215c87bd9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:12.912311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416fc2-63f7-41b7-a20a-c215c87bd9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:12.912581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416fc2-63f7-41b7-a20a-c215c87bd9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:12.923382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae416fc2-63f7-41b7-a20a-c215c87bd9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:12.924853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae416fc2-63f7-41b7-a20a-c215c87bd9a1 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:12.935332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1103/2234] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:13.204760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4e00a-0897-43e9-a4ac-c7c5d7c04fb3 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:13.206849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-01f4e00a-0897-43e9-a4ac-c7c5d7c04fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:13.218525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4e00a-0897-43e9-a4ac-c7c5d7c04fb3 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:13.223943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:13.225062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.225350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.225627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] PATH_INFO: `/v3/projects/d2766647a48649ea81045f1faedad8ba` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.226864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2766647a48649ea81045f1faedad8ba)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:13.228764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:13.274060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2766647a48649ea81045f1faedad8ba', 'request_id': 'req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:13.282069 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2766647a48649ea81045f1faedad8ba', 'request_id': 'req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:13.290880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2766647a48649ea81045f1faedad8ba', 'request_id': 'req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:13.301372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] The token cache is being invalidate because project d2766647a48649ea81045f1faedad8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:13.301661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:13.302340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-97fbd2de-adde-4fa3-9ff4-866fc8b7d70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:13.303937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1132/2235] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:13 2022] DELETE /identity/v3/projects/d2766647a48649ea81045f1faedad8ba => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:13.308781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb698ad-b606-4c00-a494-bf918893ddb3 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.309241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb698ad-b606-4c00-a494-bf918893ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.309364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb698ad-b606-4c00-a494-bf918893ddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.326092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fdb698ad-b606-4c00-a494-bf918893ddb3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:13.327308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fdb698ad-b606-4c00-a494-bf918893ddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:13.396285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1104/2236] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:13.398094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ed07f-b539-493c-a307-1a8c90aae9af None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.398522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ed07f-b539-493c-a307-1a8c90aae9af None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.399136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ed07f-b539-493c-a307-1a8c90aae9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.426080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2f6ed07f-b539-493c-a307-1a8c90aae9af None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:13.427258 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2f6ed07f-b539-493c-a307-1a8c90aae9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:13.438073 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1133/2237] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:13.442696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb698ad-b606-4c00-a494-bf918893ddb3 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:13.466116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb698ad-b606-4c00-a494-bf918893ddb3 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:13.471124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a54a6-5ff9-4c0c-a4c7-42a86bdcf117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:13.472274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a54a6-5ff9-4c0c-a4c7-42a86bdcf117 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.472754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a54a6-5ff9-4c0c-a4c7-42a86bdcf117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.473285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a54a6-5ff9-4c0c-a4c7-42a86bdcf117 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.474210 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a54a6-5ff9-4c0c-a4c7-42a86bdcf117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:27:13.474929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a54a6-5ff9-4c0c-a4c7-42a86bdcf117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:13.477733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a54a6-5ff9-4c0c-a4c7-42a86bdcf117 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:13.493760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1105/2238] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:27:13.498494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ed07f-b539-493c-a307-1a8c90aae9af None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:13.523623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ed07f-b539-493c-a307-1a8c90aae9af None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:13.538744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1717b5-d40f-48e4-b567-3e4669b571ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:13.541398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1717b5-d40f-48e4-b567-3e4669b571ea admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.541700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1717b5-d40f-48e4-b567-3e4669b571ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.545422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1717b5-d40f-48e4-b567-3e4669b571ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.545422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1717b5-d40f-48e4-b567-3e4669b571ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:13.545422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1717b5-d40f-48e4-b567-3e4669b571ea admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:13.576817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1134/2239] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:13 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:13.581061 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a54a6-5ff9-4c0c-a4c7-42a86bdcf117 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:13.592408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a54a6-5ff9-4c0c-a4c7-42a86bdcf117 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:13.659968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77de036-6eda-4309-a692-057ccd42c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:13.660808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de036-6eda-4309-a692-057ccd42c638 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.661393 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de036-6eda-4309-a692-057ccd42c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.661825 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77de036-6eda-4309-a692-057ccd42c638 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.662643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77de036-6eda-4309-a692-057ccd42c638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:13.664585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77de036-6eda-4309-a692-057ccd42c638 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:13.686464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1106/2240] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:13 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:13.691119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1717b5-d40f-48e4-b567-3e4669b571ea admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:13.702343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1717b5-d40f-48e4-b567-3e4669b571ea admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:13.708943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153480a1-fec1-4a71-9104-20cb0f170e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:13.709693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153480a1-fec1-4a71-9104-20cb0f170e3f admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.710048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153480a1-fec1-4a71-9104-20cb0f170e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.710479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153480a1-fec1-4a71-9104-20cb0f170e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.711287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153480a1-fec1-4a71-9104-20cb0f170e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:13.714038 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153480a1-fec1-4a71-9104-20cb0f170e3f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:13.727118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1135/2241] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:27:13.729342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77de036-6eda-4309-a692-057ccd42c638 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:13.740953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77de036-6eda-4309-a692-057ccd42c638 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:13.747162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af652a-c9a1-4904-b231-f5e85d8659f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:13.748065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af652a-c9a1-4904-b231-f5e85d8659f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.748538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af652a-c9a1-4904-b231-f5e85d8659f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.749202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af652a-c9a1-4904-b231-f5e85d8659f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.750141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af652a-c9a1-4904-b231-f5e85d8659f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:13.752076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af652a-c9a1-4904-b231-f5e85d8659f0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:13.766420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1107/2242] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:13.774294 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153480a1-fec1-4a71-9104-20cb0f170e3f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:13.785208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153480a1-fec1-4a71-9104-20cb0f170e3f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:13.792531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da01fe-da82-49ee-af78-c55cb6658f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:13.793495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da01fe-da82-49ee-af78-c55cb6658f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.793780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da01fe-da82-49ee-af78-c55cb6658f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.794220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da01fe-da82-49ee-af78-c55cb6658f14 admin admin] PATH_INFO: `/v3/projects/c67b239e9580469aaa5714c21a4c590d/users/f1db4aee3a4d43ccb111eb7ede0510d9/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.814317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da01fe-da82-49ee-af78-c55cb6658f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67b239e9580469aaa5714c21a4c590d, user_id=f1db4aee3a4d43ccb111eb7ede0510d9, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:13.818069 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1da01fe-da82-49ee-af78-c55cb6658f14 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:13.838844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1136/2243] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:13 2022] PUT /identity/v3/projects/c67b239e9580469aaa5714c21a4c590d/users/f1db4aee3a4d43ccb111eb7ede0510d9/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:13.841053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e6f24-fbe8-4c65-bef9-177b41b05b37 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.841330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e6f24-fbe8-4c65-bef9-177b41b05b37 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.841644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e6f24-fbe8-4c65-bef9-177b41b05b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.860519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b09e6f24-fbe8-4c65-bef9-177b41b05b37 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:13.861741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b09e6f24-fbe8-4c65-bef9-177b41b05b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:13.873491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da01fe-da82-49ee-af78-c55cb6658f14 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:13.875276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c1da01fe-da82-49ee-af78-c55cb6658f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:13.930719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1108/2244] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:13.939789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e6f24-fbe8-4c65-bef9-177b41b05b37 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:13.942045 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b09e6f24-fbe8-4c65-bef9-177b41b05b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:13.948135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da01fe-da82-49ee-af78-c55cb6658f14 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:13.952880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:13.953783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:13.954008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:13.954304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] PATH_INFO: `/v3/users/4bf603ba142e42aabc714257bf8465e8` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:13.955536 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf603ba142e42aabc714257bf8465e8)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:13.957965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:14.004572 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e6f24-fbe8-4c65-bef9-177b41b05b37 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:14.008363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901e0f3-9cc1-4342-ac79-6071a5188f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:14.009012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901e0f3-9cc1-4342-ac79-6071a5188f30 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:14.009300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901e0f3-9cc1-4342-ac79-6071a5188f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:14.009580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901e0f3-9cc1-4342-ac79-6071a5188f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:14.011175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf603ba142e42aabc714257bf8465e8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:14.019359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf603ba142e42aabc714257bf8465e8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:14.022638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901e0f3-9cc1-4342-ac79-6071a5188f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:14.024236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901e0f3-9cc1-4342-ac79-6071a5188f30 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:14.029416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf603ba142e42aabc714257bf8465e8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:14.030550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf603ba142e42aabc714257bf8465e8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:14.031483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf603ba142e42aabc714257bf8465e8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:14.036506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1109/2245] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:27:14.053551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1137/2246] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:27:13 2022] DELETE /identity/v3/users/4bf603ba142e42aabc714257bf8465e8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:14.059907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaaf22-493d-46e9-a970-49de5f4d5b02 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:14.060285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaaf22-493d-46e9-a970-49de5f4d5b02 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:14.060587 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaaf22-493d-46e9-a970-49de5f4d5b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:14.081926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-9efaaf22-493d-46e9-a970-49de5f4d5b02 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:14.083445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9efaaf22-493d-46e9-a970-49de5f4d5b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:14.162402 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1110/2247] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:14.173774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:14.175310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:14.248162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502124cf-7de4-4d26-bf37-d6b3fa58174f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:14.255280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a1726-10dd-4933-8d65-6eb7e10eefbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:14.255947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a1726-10dd-4933-8d65-6eb7e10eefbc service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:14.256230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a1726-10dd-4933-8d65-6eb7e10eefbc service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:14.256526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a1726-10dd-4933-8d65-6eb7e10eefbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:14.267532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a1726-10dd-4933-8d65-6eb7e10eefbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:14.269209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a1726-10dd-4933-8d65-6eb7e10eefbc service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:14.280829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1138/2248] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:27:14.867357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95ac0-9122-4748-9d4a-f6bcbe314533 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:14.868263 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95ac0-9122-4748-9d4a-f6bcbe314533 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:14.868550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95ac0-9122-4748-9d4a-f6bcbe314533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:14.902844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ffe95ac0-9122-4748-9d4a-f6bcbe314533 None None] MFA Rules not processed for user `f1db4aee3a4d43ccb111eb7ede0510d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:14.904356 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ffe95ac0-9122-4748-9d4a-f6bcbe314533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:14.996801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1111/2249] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:15.003575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a1726-10dd-4933-8d65-6eb7e10eefbc service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:15.004993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-174a1726-10dd-4933-8d65-6eb7e10eefbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:15.013625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe95ac0-9122-4748-9d4a-f6bcbe314533 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:15.017695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ffe95ac0-9122-4748-9d4a-f6bcbe314533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:15.021270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a1726-10dd-4933-8d65-6eb7e10eefbc service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:15.038593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:15.038593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:15.038593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:15.038593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] PATH_INFO: `/v3/projects/202604fa38d746519370f24dfb20b1be` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:15.040497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=202604fa38d746519370f24dfb20b1be)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:15.042898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:15.099357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202604fa38d746519370f24dfb20b1be', 'request_id': 'req-2df16561-02df-4c08-b6fa-c30e9e71bf76'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.109170 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202604fa38d746519370f24dfb20b1be', 'request_id': 'req-2df16561-02df-4c08-b6fa-c30e9e71bf76'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.115780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202604fa38d746519370f24dfb20b1be', 'request_id': 'req-2df16561-02df-4c08-b6fa-c30e9e71bf76'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.120192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe95ac0-9122-4748-9d4a-f6bcbe314533 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:15.125891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] The token cache is being invalidate because project 202604fa38d746519370f24dfb20b1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:15.126274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.127034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.129914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1139/2250] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:15 2022] DELETE /identity/v3/projects/202604fa38d746519370f24dfb20b1be => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:15.133698 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:15.136096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:15.181870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a34247-9e06-41a9-bd27-a2807e5b10ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:15.182835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34247-9e06-41a9-bd27-a2807e5b10ca service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:15.183538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34247-9e06-41a9-bd27-a2807e5b10ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:15.183991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a34247-9e06-41a9-bd27-a2807e5b10ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:15.187759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-40a34247-9e06-41a9-bd27-a2807e5b10ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:15.223532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df16561-02df-4c08-b6fa-c30e9e71bf76 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:15.228470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:15.229545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:15.229829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:15.230105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] PATH_INFO: `/v3/users/d5c986423e4e4347b5717a1301967e14` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:15.231936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c986423e4e4347b5717a1301967e14)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:15.233861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:15.255822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a34247-9e06-41a9-bd27-a2807e5b10ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:15.257280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a34247-9e06-41a9-bd27-a2807e5b10ca service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:15.266864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1112/2251] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:15.287210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c986423e4e4347b5717a1301967e14'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.298012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c986423e4e4347b5717a1301967e14'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.308274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c986423e4e4347b5717a1301967e14'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.309175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c986423e4e4347b5717a1301967e14'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.309881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-8bd1a34d-fed7-41ea-8ac7-4830d60b68c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c986423e4e4347b5717a1301967e14'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.328522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1140/2252] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:27:15 2022] DELETE /identity/v3/users/d5c986423e4e4347b5717a1301967e14 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:15.781820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a34247-9e06-41a9-bd27-a2807e5b10ca service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:15.795894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a34247-9e06-41a9-bd27-a2807e5b10ca service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:15.885714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:15.887263 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:15.887766 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:15.888222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] PATH_INFO: `/v3/projects/b774d401c34743dca809e81e1954411d` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:15.890126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b774d401c34743dca809e81e1954411d)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:15.892841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:15.944213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b774d401c34743dca809e81e1954411d', 'request_id': 'req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.950449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b774d401c34743dca809e81e1954411d', 'request_id': 'req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.957734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b774d401c34743dca809e81e1954411d', 'request_id': 'req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.972115 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] The token cache is being invalidate because project b774d401c34743dca809e81e1954411d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:27:15.972682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.973531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-22acc86d-4b00-4a79-b95e-ff2b1ddc8aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:27:15.975988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1113/2253] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:27:15 2022] DELETE /identity/v3/projects/b774d401c34743dca809e81e1954411d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:27:15.983093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3866-a0d7-4d62-be8d-eee970c9a34a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:15.983732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3866-a0d7-4d62-be8d-eee970c9a34a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:15.984330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa3866-a0d7-4d62-be8d-eee970c9a34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.016918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-42aa3866-a0d7-4d62-be8d-eee970c9a34a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:16.020431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-42aa3866-a0d7-4d62-be8d-eee970c9a34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:16.089432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1141/2254] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:16.098131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc68c9-1445-4fb9-84d8-e7bec926cb02 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.098535 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc68c9-1445-4fb9-84d8-e7bec926cb02 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.098886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc68c9-1445-4fb9-84d8-e7bec926cb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.117715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-49cc68c9-1445-4fb9-84d8-e7bec926cb02 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:16.118953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-49cc68c9-1445-4fb9-84d8-e7bec926cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:16.130494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1114/2255] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:16.131487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa3866-a0d7-4d62-be8d-eee970c9a34a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.141096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa3866-a0d7-4d62-be8d-eee970c9a34a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.146556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a9ba-8e46-44b9-9bc7-37b4c2d73f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.147285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a9ba-8e46-44b9-9bc7-37b4c2d73f08 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.147565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a9ba-8e46-44b9-9bc7-37b4c2d73f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.147836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a9ba-8e46-44b9-9bc7-37b4c2d73f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.148554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222a9ba-8e46-44b9-9bc7-37b4c2d73f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:27:16.148886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222a9ba-8e46-44b9-9bc7-37b4c2d73f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.150764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222a9ba-8e46-44b9-9bc7-37b4c2d73f08 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.167083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1142/2256] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:27:16.168396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc68c9-1445-4fb9-84d8-e7bec926cb02 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.177850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc68c9-1445-4fb9-84d8-e7bec926cb02 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.182588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93a0a2-9cfa-43a4-a06c-488b1e9fc170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.183259 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93a0a2-9cfa-43a4-a06c-488b1e9fc170 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.183555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93a0a2-9cfa-43a4-a06c-488b1e9fc170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.183816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93a0a2-9cfa-43a4-a06c-488b1e9fc170 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.184506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93a0a2-9cfa-43a4-a06c-488b1e9fc170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.186598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93a0a2-9cfa-43a4-a06c-488b1e9fc170 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.212231 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1115/2257] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:16 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:16.216521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a9ba-8e46-44b9-9bc7-37b4c2d73f08 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.226708 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a9ba-8e46-44b9-9bc7-37b4c2d73f08 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.284555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd53c34-cbc0-46d1-a88c-a23d7d9c7807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.285129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53c34-cbc0-46d1-a88c-a23d7d9c7807 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.285411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53c34-cbc0-46d1-a88c-a23d7d9c7807 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.285683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd53c34-cbc0-46d1-a88c-a23d7d9c7807 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.286387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd53c34-cbc0-46d1-a88c-a23d7d9c7807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.288272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd53c34-cbc0-46d1-a88c-a23d7d9c7807 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.308515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1143/2258] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:16 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:27:16.312665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93a0a2-9cfa-43a4-a06c-488b1e9fc170 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.322658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93a0a2-9cfa-43a4-a06c-488b1e9fc170 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.327491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfff6a-9b35-4728-afcd-2c3252108357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.328175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfff6a-9b35-4728-afcd-2c3252108357 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.328455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfff6a-9b35-4728-afcd-2c3252108357 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.328756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfff6a-9b35-4728-afcd-2c3252108357 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.329485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfff6a-9b35-4728-afcd-2c3252108357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.331629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfff6a-9b35-4728-afcd-2c3252108357 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.342234 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1116/2259] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:16.347001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd53c34-cbc0-46d1-a88c-a23d7d9c7807 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.357974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd53c34-cbc0-46d1-a88c-a23d7d9c7807 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.362699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1f9a7-9c53-4483-b771-28d03eaee2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.363351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1f9a7-9c53-4483-b771-28d03eaee2fe admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.363634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1f9a7-9c53-4483-b771-28d03eaee2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.363907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1f9a7-9c53-4483-b771-28d03eaee2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.364619 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1f9a7-9c53-4483-b771-28d03eaee2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.366180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1f9a7-9c53-4483-b771-28d03eaee2fe admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.375745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1144/2260] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:27:16.380388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfff6a-9b35-4728-afcd-2c3252108357 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.391421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfff6a-9b35-4728-afcd-2c3252108357 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.396347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232836-ddb5-45ab-8ca8-18592b4e0f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.397227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232836-ddb5-45ab-8ca8-18592b4e0f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.397504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232836-ddb5-45ab-8ca8-18592b4e0f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.397776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232836-ddb5-45ab-8ca8-18592b4e0f6d admin admin] PATH_INFO: `/v3/projects/76a8cd1135e44066b7d8eeb2a9a05b9a/users/0104cda095fb422e83b4d8778e6227f4/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.412449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74232836-ddb5-45ab-8ca8-18592b4e0f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a8cd1135e44066b7d8eeb2a9a05b9a, user_id=0104cda095fb422e83b4d8778e6227f4, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.415109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74232836-ddb5-45ab-8ca8-18592b4e0f6d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.428636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1117/2261] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:16 2022] PUT /identity/v3/projects/76a8cd1135e44066b7d8eeb2a9a05b9a/users/0104cda095fb422e83b4d8778e6227f4/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:16.438859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a1633-4c9e-4d28-ae90-7088d01eb6b4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.439162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a1633-4c9e-4d28-ae90-7088d01eb6b4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.439421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a1633-4c9e-4d28-ae90-7088d01eb6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.467147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1e5a1633-4c9e-4d28-ae90-7088d01eb6b4 None None] MFA Rules not processed for user `0104cda095fb422e83b4d8778e6227f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:16.468352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1e5a1633-4c9e-4d28-ae90-7088d01eb6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:16.529935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1145/2262] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:16.534483 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232836-ddb5-45ab-8ca8-18592b4e0f6d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.593858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232836-ddb5-45ab-8ca8-18592b4e0f6d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.598505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14a3d7-e22c-4eb9-ad6b-a8add324b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.599160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14a3d7-e22c-4eb9-ad6b-a8add324b227 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.599444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14a3d7-e22c-4eb9-ad6b-a8add324b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.599718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14a3d7-e22c-4eb9-ad6b-a8add324b227 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.600409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14a3d7-e22c-4eb9-ad6b-a8add324b227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.602316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14a3d7-e22c-4eb9-ad6b-a8add324b227 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.626025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1118/2263] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:27:16 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:27:16.630558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a1633-4c9e-4d28-ae90-7088d01eb6b4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.641318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a1633-4c9e-4d28-ae90-7088d01eb6b4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.707727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78966fe2-f8cc-4d2d-b854-def6ca0b72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.708396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78966fe2-f8cc-4d2d-b854-def6ca0b72d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.708678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78966fe2-f8cc-4d2d-b854-def6ca0b72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.708949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78966fe2-f8cc-4d2d-b854-def6ca0b72d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.709626 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78966fe2-f8cc-4d2d-b854-def6ca0b72d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.711568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78966fe2-f8cc-4d2d-b854-def6ca0b72d6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.733167 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1146/2264] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:27:16 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:27:16.734409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14a3d7-e22c-4eb9-ad6b-a8add324b227 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.745313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14a3d7-e22c-4eb9-ad6b-a8add324b227 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.750458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277baf1-a645-40f6-9fc9-c73e0f15783f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.751135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277baf1-a645-40f6-9fc9-c73e0f15783f admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.751421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277baf1-a645-40f6-9fc9-c73e0f15783f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.751726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277baf1-a645-40f6-9fc9-c73e0f15783f admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.753146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277baf1-a645-40f6-9fc9-c73e0f15783f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.754778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277baf1-a645-40f6-9fc9-c73e0f15783f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.765499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1119/2265] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:16.769771 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78966fe2-f8cc-4d2d-b854-def6ca0b72d6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.779758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78966fe2-f8cc-4d2d-b854-def6ca0b72d6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.784340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cbba7-1faa-482f-af82-be86cd42e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.785210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cbba7-1faa-482f-af82-be86cd42e994 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.785490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cbba7-1faa-482f-af82-be86cd42e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.785767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cbba7-1faa-482f-af82-be86cd42e994 admin admin] PATH_INFO: `/v3/projects/15c68113556841aaa3bb67701ffe9ff1/users/e7e3aea4d80b46c88160b0679371bb6c/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.800221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cbba7-1faa-482f-af82-be86cd42e994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c68113556841aaa3bb67701ffe9ff1, user_id=e7e3aea4d80b46c88160b0679371bb6c, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.802882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cbba7-1faa-482f-af82-be86cd42e994 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.816035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1147/2266] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:16 2022] PUT /identity/v3/projects/15c68113556841aaa3bb67701ffe9ff1/users/e7e3aea4d80b46c88160b0679371bb6c/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:16.820510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277baf1-a645-40f6-9fc9-c73e0f15783f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.830102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277baf1-a645-40f6-9fc9-c73e0f15783f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.888541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863a85f-16b8-4aa2-ad93-10cd455a48b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.889290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863a85f-16b8-4aa2-ad93-10cd455a48b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.889585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863a85f-16b8-4aa2-ad93-10cd455a48b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.889868 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863a85f-16b8-4aa2-ad93-10cd455a48b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.890679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863a85f-16b8-4aa2-ad93-10cd455a48b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.892688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863a85f-16b8-4aa2-ad93-10cd455a48b2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.904840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1120/2267] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:27:16.908938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cbba7-1faa-482f-af82-be86cd42e994 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:16.919406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cbba7-1faa-482f-af82-be86cd42e994 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:16.924184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3669f-65ad-4f42-8860-049dd30f8928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:16.925590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3669f-65ad-4f42-8860-049dd30f8928 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.925876 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3669f-65ad-4f42-8860-049dd30f8928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.926154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3669f-65ad-4f42-8860-049dd30f8928 admin admin] PATH_INFO: `/v3/projects/15c68113556841aaa3bb67701ffe9ff1/users/e7e3aea4d80b46c88160b0679371bb6c/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.928149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3669f-65ad-4f42-8860-049dd30f8928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c68113556841aaa3bb67701ffe9ff1, user_id=e7e3aea4d80b46c88160b0679371bb6c, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:16.930873 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3669f-65ad-4f42-8860-049dd30f8928 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:16.942278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1148/2268] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:27:16 2022] PUT /identity/v3/projects/15c68113556841aaa3bb67701ffe9ff1/users/e7e3aea4d80b46c88160b0679371bb6c/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:27:16.953680 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f47415-d30a-4e41-a128-5385818f65f4 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:16.953984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f47415-d30a-4e41-a128-5385818f65f4 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:16.954314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f47415-d30a-4e41-a128-5385818f65f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:16.981182 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a5f47415-d30a-4e41-a128-5385818f65f4 None None] MFA Rules not processed for user `e7e3aea4d80b46c88160b0679371bb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:16.982427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a5f47415-d30a-4e41-a128-5385818f65f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:17.051699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1121/2269] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:27:17.062505 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3669f-65ad-4f42-8860-049dd30f8928 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:17.064188 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ded3669f-65ad-4f42-8860-049dd30f8928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:17.120692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3669f-65ad-4f42-8860-049dd30f8928 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:17.124342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244a0b0-06c0-484f-a279-103305ffde37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:17.124985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244a0b0-06c0-484f-a279-103305ffde37 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:17.125265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244a0b0-06c0-484f-a279-103305ffde37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:17.125538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244a0b0-06c0-484f-a279-103305ffde37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:17.191708 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244a0b0-06c0-484f-a279-103305ffde37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:17.193239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244a0b0-06c0-484f-a279-103305ffde37 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:17.202416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1149/2270] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:27:17.748961 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d9285-9736-4c0f-bf08-5686a1cc8858 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:17.749252 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d9285-9736-4c0f-bf08-5686a1cc8858 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:17.749530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d9285-9736-4c0f-bf08-5686a1cc8858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:17.767798 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-9e0d9285-9736-4c0f-bf08-5686a1cc8858 None None] MFA Rules not processed for user `f1db4aee3a4d43ccb111eb7ede0510d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:27:17.769461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9e0d9285-9736-4c0f-bf08-5686a1cc8858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:17.821521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1122/2271] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:27:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:27:25.937176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244a0b0-06c0-484f-a279-103305ffde37 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:27:25.939347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1244a0b0-06c0-484f-a279-103305ffde37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:27:25.953366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244a0b0-06c0-484f-a279-103305ffde37 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:27:25.958268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924986b-6aac-424d-93d3-eda6886b4b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:27:25.958995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924986b-6aac-424d-93d3-eda6886b4b39 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:27:25.959279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924986b-6aac-424d-93d3-eda6886b4b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:27:25.959557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924986b-6aac-424d-93d3-eda6886b4b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:27:25.968953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924986b-6aac-424d-93d3-eda6886b4b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:27:25.970410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924986b-6aac-424d-93d3-eda6886b4b39 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:27:25.980089 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1150/2272] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:27:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:27.626479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d9285-9736-4c0f-bf08-5686a1cc8858 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:27.690667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924986b-6aac-424d-93d3-eda6886b4b39 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:27.692503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6924986b-6aac-424d-93d3-eda6886b4b39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:27.735854 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d9285-9736-4c0f-bf08-5686a1cc8858 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:27.740603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:27.741471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:27.741756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:27.742035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] PATH_INFO: `/v3/users/0104cda095fb422e83b4d8778e6227f4` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:27.743271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0104cda095fb422e83b4d8778e6227f4)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:27.745210 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:27.752422 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924986b-6aac-424d-93d3-eda6886b4b39 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:27.757052 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:27.757919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:27.758207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:27.758511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] PATH_INFO: `/v3/users/d825058cec6f40178f74ddb5558cbf61` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:27.759706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d825058cec6f40178f74ddb5558cbf61)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:27.761598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:27.791153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0104cda095fb422e83b4d8778e6227f4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.800374 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0104cda095fb422e83b4d8778e6227f4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.809411 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0104cda095fb422e83b4d8778e6227f4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.810188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0104cda095fb422e83b4d8778e6227f4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.811024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d6f6a4b5-3d63-41d1-a1cf-620af9dcd06a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0104cda095fb422e83b4d8778e6227f4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.820651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd825058cec6f40178f74ddb5558cbf61'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.827522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd825058cec6f40178f74ddb5558cbf61'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.831612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1123/2273] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:27 2022] DELETE /identity/v3/users/0104cda095fb422e83b4d8778e6227f4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:27.835665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1b24-7bbd-4d1b-a47c-090cbdfa8d1d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:27.835985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1b24-7bbd-4d1b-a47c-090cbdfa8d1d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:27.836260 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e1b24-7bbd-4d1b-a47c-090cbdfa8d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:27.837651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd825058cec6f40178f74ddb5558cbf61'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.838619 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd825058cec6f40178f74ddb5558cbf61'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.839425 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-30564d5a-548f-4f2f-9317-01a130b526c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd825058cec6f40178f74ddb5558cbf61'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:27.859629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1151/2274] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:27 2022] DELETE /identity/v3/users/d825058cec6f40178f74ddb5558cbf61 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:27.862077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ec7e1b24-7bbd-4d1b-a47c-090cbdfa8d1d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:27.862537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f47eb-fa97-4fdb-844b-12cd5fabd2e4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:27.862929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f47eb-fa97-4fdb-844b-12cd5fabd2e4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:27.863277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6f47eb-fa97-4fdb-844b-12cd5fabd2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:27.863389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ec7e1b24-7bbd-4d1b-a47c-090cbdfa8d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:27.881724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-fc6f47eb-fa97-4fdb-844b-12cd5fabd2e4 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:27.882944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fc6f47eb-fa97-4fdb-844b-12cd5fabd2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:27.926834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1124/2275] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:27.938130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e1b24-7bbd-4d1b-a47c-090cbdfa8d1d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:27.939709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ec7e1b24-7bbd-4d1b-a47c-090cbdfa8d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:27.954599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1152/2276] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:27.965924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f47eb-fa97-4fdb-844b-12cd5fabd2e4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:27.967400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fc6f47eb-fa97-4fdb-844b-12cd5fabd2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:28.034958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e1b24-7bbd-4d1b-a47c-090cbdfa8d1d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:28.037433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6f47eb-fa97-4fdb-844b-12cd5fabd2e4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:28.038813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a409c-a68f-4697-a2f1-5f59f318a2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:28.039460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a409c-a68f-4697-a2f1-5f59f318a2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:28.039749 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a409c-a68f-4697-a2f1-5f59f318a2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:28.040024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a409c-a68f-4697-a2f1-5f59f318a2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:28.041466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519bf4b-bc4a-4ec0-b128-9af289bd456c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:28.042104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519bf4b-bc4a-4ec0-b128-9af289bd456c service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:28.042412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519bf4b-bc4a-4ec0-b128-9af289bd456c service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:28.042685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519bf4b-bc4a-4ec0-b128-9af289bd456c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:28.049968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a409c-a68f-4697-a2f1-5f59f318a2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:28.051472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a409c-a68f-4697-a2f1-5f59f318a2e9 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:28.052476 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519bf4b-bc4a-4ec0-b128-9af289bd456c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:28.053993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519bf4b-bc4a-4ec0-b128-9af289bd456c service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:28.061390 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1125/2277] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:28:28.063842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1153/2278] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:28:28.625197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a409c-a68f-4697-a2f1-5f59f318a2e9 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:28.626800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f44a409c-a68f-4697-a2f1-5f59f318a2e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:28.658475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519bf4b-bc4a-4ec0-b128-9af289bd456c service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:28.660672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2519bf4b-bc4a-4ec0-b128-9af289bd456c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:28.665049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a409c-a68f-4697-a2f1-5f59f318a2e9 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:28.672222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:28.673211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:28.673574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:28.674003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] PATH_INFO: `/v3/projects/83f3c6bf5e284e8eba3f9c72540ad8b1` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:28.675473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f3c6bf5e284e8eba3f9c72540ad8b1)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:28.677637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519bf4b-bc4a-4ec0-b128-9af289bd456c service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:28.678733 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:28.682722 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:28.683974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:28.684385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:28.684746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] PATH_INFO: `/v3/projects/76a8cd1135e44066b7d8eeb2a9a05b9a` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:28.686242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a8cd1135e44066b7d8eeb2a9a05b9a)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:28.689009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:28.726590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f3c6bf5e284e8eba3f9c72540ad8b1', 'request_id': 'req-781082a9-8dcb-4e7c-9169-6dd7a60b636b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.733013 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f3c6bf5e284e8eba3f9c72540ad8b1', 'request_id': 'req-781082a9-8dcb-4e7c-9169-6dd7a60b636b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.738785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f3c6bf5e284e8eba3f9c72540ad8b1', 'request_id': 'req-781082a9-8dcb-4e7c-9169-6dd7a60b636b'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.741081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a8cd1135e44066b7d8eeb2a9a05b9a', 'request_id': 'req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.748871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a8cd1135e44066b7d8eeb2a9a05b9a', 'request_id': 'req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.754615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] The token cache is being invalidate because project 83f3c6bf5e284e8eba3f9c72540ad8b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:28.754907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.755588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.755702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a8cd1135e44066b7d8eeb2a9a05b9a', 'request_id': 'req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.757487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1126/2279] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:28 2022] DELETE /identity/v3/projects/83f3c6bf5e284e8eba3f9c72540ad8b1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:28.767136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] The token cache is being invalidate because project 76a8cd1135e44066b7d8eeb2a9a05b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:28.767460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.768168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.770481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1154/2280] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:28 2022] DELETE /identity/v3/projects/76a8cd1135e44066b7d8eeb2a9a05b9a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:28.782520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:28.784229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:28.853792 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781082a9-8dcb-4e7c-9169-6dd7a60b636b admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:28.911969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:28.912770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:28.913075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:28.913380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] PATH_INFO: `/v3/users/e7e3aea4d80b46c88160b0679371bb6c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:28.914672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e3aea4d80b46c88160b0679371bb6c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:28.916605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:28.960428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e3aea4d80b46c88160b0679371bb6c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.966935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e3aea4d80b46c88160b0679371bb6c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.974775 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e3aea4d80b46c88160b0679371bb6c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.975389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e3aea4d80b46c88160b0679371bb6c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.976025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e161f437-0af1-4ae4-b09b-a54594c64ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e3aea4d80b46c88160b0679371bb6c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:28.992578 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1127/2281] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:28 2022] DELETE /identity/v3/users/e7e3aea4d80b46c88160b0679371bb6c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:29.262115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:29.263630 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:29.277431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4a6e5-3f4a-4e2a-9a85-e0921891457e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:29.330820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:29.331666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.331945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.332215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] PATH_INFO: `/v3/projects/15c68113556841aaa3bb67701ffe9ff1` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.333355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c68113556841aaa3bb67701ffe9ff1)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:29.335267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:29.388019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c68113556841aaa3bb67701ffe9ff1', 'request_id': 'req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:29.399123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c68113556841aaa3bb67701ffe9ff1', 'request_id': 'req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:29.405975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c68113556841aaa3bb67701ffe9ff1', 'request_id': 'req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:29.418132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] The token cache is being invalidate because project 15c68113556841aaa3bb67701ffe9ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:29.418443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:29.419110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f70d7aa9-97f7-446a-9920-aca6a5cbb79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:29.420933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1155/2282] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:29 2022] DELETE /identity/v3/projects/15c68113556841aaa3bb67701ffe9ff1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:29.425424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2621ba9-c2c6-4e35-8fe3-d55a53fd89fb None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.425752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2621ba9-c2c6-4e35-8fe3-d55a53fd89fb None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.426032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2621ba9-c2c6-4e35-8fe3-d55a53fd89fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.480343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c2621ba9-c2c6-4e35-8fe3-d55a53fd89fb None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:29.481966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c2621ba9-c2c6-4e35-8fe3-d55a53fd89fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:29.547147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1128/2283] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:29.554925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeeee8-ea6c-422f-8906-d6489836af05 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.555239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeeee8-ea6c-422f-8906-d6489836af05 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.555543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edeeee8-ea6c-422f-8906-d6489836af05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.573330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-8edeeee8-ea6c-422f-8906-d6489836af05 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:29.574549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8edeeee8-ea6c-422f-8906-d6489836af05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:29.582745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1156/2284] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:29.586846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2621ba9-c2c6-4e35-8fe3-d55a53fd89fb None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:29.596717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2621ba9-c2c6-4e35-8fe3-d55a53fd89fb None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:29.601206 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f802f-be84-4ba4-889c-ec483dcb7881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:29.601846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f802f-be84-4ba4-889c-ec483dcb7881 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.602126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f802f-be84-4ba4-889c-ec483dcb7881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.602442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f802f-be84-4ba4-889c-ec483dcb7881 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.603188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f802f-be84-4ba4-889c-ec483dcb7881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:28:29.603490 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f802f-be84-4ba4-889c-ec483dcb7881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:29.605067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f802f-be84-4ba4-889c-ec483dcb7881 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:29.616288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1129/2285] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:28:29.620362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeeee8-ea6c-422f-8906-d6489836af05 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:29.629252 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edeeee8-ea6c-422f-8906-d6489836af05 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:29.633761 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c859-4778-4a68-9a96-39a8c4fb349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:29.634443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c859-4778-4a68-9a96-39a8c4fb349d admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.634711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c859-4778-4a68-9a96-39a8c4fb349d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.634985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c859-4778-4a68-9a96-39a8c4fb349d admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.635665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1c859-4778-4a68-9a96-39a8c4fb349d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:29.637554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1c859-4778-4a68-9a96-39a8c4fb349d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:29.662935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1157/2286] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:29 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:29.667341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f802f-be84-4ba4-889c-ec483dcb7881 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:29.677210 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f802f-be84-4ba4-889c-ec483dcb7881 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:29.729511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00742d91-4d6a-447b-8a8c-336fe9011562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:29.730101 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00742d91-4d6a-447b-8a8c-336fe9011562 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.730412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00742d91-4d6a-447b-8a8c-336fe9011562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.730689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00742d91-4d6a-447b-8a8c-336fe9011562 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.731373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00742d91-4d6a-447b-8a8c-336fe9011562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:29.733257 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00742d91-4d6a-447b-8a8c-336fe9011562 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:29.751985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1130/2287] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:29 2022] POST /identity/v3/users => generated 291 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:29.755989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c859-4778-4a68-9a96-39a8c4fb349d admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:29.766403 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c859-4778-4a68-9a96-39a8c4fb349d admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:29.771087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d186a7-a36a-47fb-81ac-29cedb7c1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:29.771742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d186a7-a36a-47fb-81ac-29cedb7c1ffa admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.772020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d186a7-a36a-47fb-81ac-29cedb7c1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.772293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d186a7-a36a-47fb-81ac-29cedb7c1ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.773011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d186a7-a36a-47fb-81ac-29cedb7c1ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:29.774885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d186a7-a36a-47fb-81ac-29cedb7c1ffa admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:29.785091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1158/2288] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:29.788838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00742d91-4d6a-447b-8a8c-336fe9011562 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:29.799067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00742d91-4d6a-447b-8a8c-336fe9011562 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:29.803665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd2edf-ad86-40ab-9450-0042ccd65e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:29.804345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd2edf-ad86-40ab-9450-0042ccd65e03 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.804630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd2edf-ad86-40ab-9450-0042ccd65e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.804906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd2edf-ad86-40ab-9450-0042ccd65e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.805743 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd2edf-ad86-40ab-9450-0042ccd65e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:29.807383 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd2edf-ad86-40ab-9450-0042ccd65e03 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:29.816982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1131/2289] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:29.820712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d186a7-a36a-47fb-81ac-29cedb7c1ffa admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:29.831030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d186a7-a36a-47fb-81ac-29cedb7c1ffa admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:29.835509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae12471-ef53-41e8-b28a-43390504e8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:29.836367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae12471-ef53-41e8-b28a-43390504e8db admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.836641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae12471-ef53-41e8-b28a-43390504e8db admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.836910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae12471-ef53-41e8-b28a-43390504e8db admin admin] PATH_INFO: `/v3/projects/a45e6ca883de4c839031f6c4783f05de/users/5c2909e8d3c74a34bd250445be4e9c57/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.850997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae12471-ef53-41e8-b28a-43390504e8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45e6ca883de4c839031f6c4783f05de, user_id=5c2909e8d3c74a34bd250445be4e9c57, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:29.853597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae12471-ef53-41e8-b28a-43390504e8db admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:29.865801 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1159/2290] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:29 2022] PUT /identity/v3/projects/a45e6ca883de4c839031f6c4783f05de/users/5c2909e8d3c74a34bd250445be4e9c57/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:29.877352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01f2b5-c02d-45bb-8a18-fa874469b264 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:29.877666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01f2b5-c02d-45bb-8a18-fa874469b264 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:29.877950 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01f2b5-c02d-45bb-8a18-fa874469b264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:29.905679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-cc01f2b5-c02d-45bb-8a18-fa874469b264 None None] MFA Rules not processed for user `5c2909e8d3c74a34bd250445be4e9c57`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:29.906936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-cc01f2b5-c02d-45bb-8a18-fa874469b264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:29.972988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1132/2291] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:29.977610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae12471-ef53-41e8-b28a-43390504e8db admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:30.039577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae12471-ef53-41e8-b28a-43390504e8db admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:30.044172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b96e0-3a01-4837-97c2-044673450ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:30.044828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b96e0-3a01-4837-97c2-044673450ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:30.045121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b96e0-3a01-4837-97c2-044673450ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:30.045402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b96e0-3a01-4837-97c2-044673450ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:30.046092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b96e0-3a01-4837-97c2-044673450ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:30.048591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b96e0-3a01-4837-97c2-044673450ac8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:30.072161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1160/2292] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:29 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:30.076265 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01f2b5-c02d-45bb-8a18-fa874469b264 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:30.086750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01f2b5-c02d-45bb-8a18-fa874469b264 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:30.140789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c7ca0-f50d-4a7a-a7be-2dc9784c36f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:30.141478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c7ca0-f50d-4a7a-a7be-2dc9784c36f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:30.141762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c7ca0-f50d-4a7a-a7be-2dc9784c36f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:30.142036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c7ca0-f50d-4a7a-a7be-2dc9784c36f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:30.142751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c7ca0-f50d-4a7a-a7be-2dc9784c36f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:30.144644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c7ca0-f50d-4a7a-a7be-2dc9784c36f1 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:30.164311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1133/2293] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:30 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:28:30.168397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b96e0-3a01-4837-97c2-044673450ac8 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:30.179006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b96e0-3a01-4837-97c2-044673450ac8 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:30.183456 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17c8f4-2266-434e-8e9e-888ccdd9548f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:30.184103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17c8f4-2266-434e-8e9e-888ccdd9548f admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:30.184382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17c8f4-2266-434e-8e9e-888ccdd9548f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:30.184660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17c8f4-2266-434e-8e9e-888ccdd9548f admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:30.185372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17c8f4-2266-434e-8e9e-888ccdd9548f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:30.186985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17c8f4-2266-434e-8e9e-888ccdd9548f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:30.196882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1161/2294] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:30.200753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c7ca0-f50d-4a7a-a7be-2dc9784c36f1 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:30.210221 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c7ca0-f50d-4a7a-a7be-2dc9784c36f1 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:30.214963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a76d-b860-4a25-814e-b171c153f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:30.215843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a76d-b860-4a25-814e-b171c153f02f admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:30.216119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a76d-b860-4a25-814e-b171c153f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:30.216388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770a76d-b860-4a25-814e-b171c153f02f admin admin] PATH_INFO: `/v3/projects/eaad19c9bc4f40d39c9a7932c85dfffa/users/ab1d7d144e3e4403988e30dffaa8c845/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:30.230832 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a76d-b860-4a25-814e-b171c153f02f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaad19c9bc4f40d39c9a7932c85dfffa, user_id=ab1d7d144e3e4403988e30dffaa8c845, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:30.235243 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770a76d-b860-4a25-814e-b171c153f02f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:30.250815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1134/2295] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:30 2022] PUT /identity/v3/projects/eaad19c9bc4f40d39c9a7932c85dfffa/users/ab1d7d144e3e4403988e30dffaa8c845/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:30.254997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17c8f4-2266-434e-8e9e-888ccdd9548f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:30.264642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17c8f4-2266-434e-8e9e-888ccdd9548f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:30.323604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14dd30-2f89-4bcc-9581-3b8f4f79bf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:30.324278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14dd30-2f89-4bcc-9581-3b8f4f79bf0b admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:30.324565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14dd30-2f89-4bcc-9581-3b8f4f79bf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:30.324841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14dd30-2f89-4bcc-9581-3b8f4f79bf0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:30.325568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14dd30-2f89-4bcc-9581-3b8f4f79bf0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:30.327176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14dd30-2f89-4bcc-9581-3b8f4f79bf0b admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:30.337297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1162/2296] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:30.341493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a76d-b860-4a25-814e-b171c153f02f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:30.351575 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770a76d-b860-4a25-814e-b171c153f02f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:30.356333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77495d7-eec4-4a53-80a3-94c26ff35fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:30.357209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77495d7-eec4-4a53-80a3-94c26ff35fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:30.357508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77495d7-eec4-4a53-80a3-94c26ff35fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:30.357769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77495d7-eec4-4a53-80a3-94c26ff35fb7 admin admin] PATH_INFO: `/v3/projects/eaad19c9bc4f40d39c9a7932c85dfffa/users/ab1d7d144e3e4403988e30dffaa8c845/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:30.360307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77495d7-eec4-4a53-80a3-94c26ff35fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaad19c9bc4f40d39c9a7932c85dfffa, user_id=ab1d7d144e3e4403988e30dffaa8c845, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:30.362984 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77495d7-eec4-4a53-80a3-94c26ff35fb7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:30.373500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1135/2297] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:30 2022] PUT /identity/v3/projects/eaad19c9bc4f40d39c9a7932c85dfffa/users/ab1d7d144e3e4403988e30dffaa8c845/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:30.384036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a0c5-4859-417a-b91e-24fc77bd1cde None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:30.384331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a0c5-4859-417a-b91e-24fc77bd1cde None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:30.384613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a0c5-4859-417a-b91e-24fc77bd1cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:30.412662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-fd19a0c5-4859-417a-b91e-24fc77bd1cde None None] MFA Rules not processed for user `ab1d7d144e3e4403988e30dffaa8c845`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:30.413976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fd19a0c5-4859-417a-b91e-24fc77bd1cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:30.482814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1163/2298] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:30.494459 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77495d7-eec4-4a53-80a3-94c26ff35fb7 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:30.496661 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b77495d7-eec4-4a53-80a3-94c26ff35fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:30.588389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77495d7-eec4-4a53-80a3-94c26ff35fb7 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:30.596371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61752909-e37f-4097-b9fc-c986b6e7d022 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:30.597252 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752909-e37f-4097-b9fc-c986b6e7d022 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:30.597763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752909-e37f-4097-b9fc-c986b6e7d022 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:30.598431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61752909-e37f-4097-b9fc-c986b6e7d022 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:30.609366 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752909-e37f-4097-b9fc-c986b6e7d022 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:30.610852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61752909-e37f-4097-b9fc-c986b6e7d022 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:30.620920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1136/2299] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:30.981519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19a0c5-4859-417a-b91e-24fc77bd1cde None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:31.040498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19a0c5-4859-417a-b91e-24fc77bd1cde None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:31.044802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:31.045646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:31.045923 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:31.046195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] PATH_INFO: `/v3/users/5c2909e8d3c74a34bd250445be4e9c57` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:31.047410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2909e8d3c74a34bd250445be4e9c57)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:31.049309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:31.091974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2909e8d3c74a34bd250445be4e9c57'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.098574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2909e8d3c74a34bd250445be4e9c57'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.106182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2909e8d3c74a34bd250445be4e9c57'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.106839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2909e8d3c74a34bd250445be4e9c57'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.107447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2909e8d3c74a34bd250445be4e9c57'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.124229 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1164/2300] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:30 2022] DELETE /identity/v3/users/5c2909e8d3c74a34bd250445be4e9c57 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:31.128712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519b56-a329-4a40-b6d0-b2f019dfb2f1 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:31.129157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519b56-a329-4a40-b6d0-b2f019dfb2f1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:31.129249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519b56-a329-4a40-b6d0-b2f019dfb2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:31.146429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d6519b56-a329-4a40-b6d0-b2f019dfb2f1 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:31.147614 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d6519b56-a329-4a40-b6d0-b2f019dfb2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:31.203874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1137/2301] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:31.218454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:31.219863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:31.273857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5589d47-fa94-4898-aefc-cc72bffd1cc5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:31.277415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92809252-6ec7-440c-b4dd-75bc519b6fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:31.278047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92809252-6ec7-440c-b4dd-75bc519b6fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:31.278354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92809252-6ec7-440c-b4dd-75bc519b6fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:31.278624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92809252-6ec7-440c-b4dd-75bc519b6fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:31.287300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92809252-6ec7-440c-b4dd-75bc519b6fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:31.288704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92809252-6ec7-440c-b4dd-75bc519b6fb1 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:31.298206 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1165/2302] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:31.558112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519b56-a329-4a40-b6d0-b2f019dfb2f1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:31.559579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d6519b56-a329-4a40-b6d0-b2f019dfb2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:31.573875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519b56-a329-4a40-b6d0-b2f019dfb2f1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:31.579018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:31.580488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:31.580920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:31.581200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] PATH_INFO: `/v3/projects/a45e6ca883de4c839031f6c4783f05de` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:31.582460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45e6ca883de4c839031f6c4783f05de)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:31.584397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:31.628236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473671-322a-4524-a6e4-6c12ea560abc None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:31.628526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473671-322a-4524-a6e4-6c12ea560abc None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:31.628806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93473671-322a-4524-a6e4-6c12ea560abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:31.634350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45e6ca883de4c839031f6c4783f05de', 'request_id': 'req-3b03b5bc-94a0-4723-aaea-267b0b6304a9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.640884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45e6ca883de4c839031f6c4783f05de', 'request_id': 'req-3b03b5bc-94a0-4723-aaea-267b0b6304a9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.647047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-93473671-322a-4524-a6e4-6c12ea560abc None None] MFA Rules not processed for user `f1db4aee3a4d43ccb111eb7ede0510d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:31.647284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45e6ca883de4c839031f6c4783f05de', 'request_id': 'req-3b03b5bc-94a0-4723-aaea-267b0b6304a9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.648259 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-93473671-322a-4524-a6e4-6c12ea560abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:31.663259 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] The token cache is being invalidate because project a45e6ca883de4c839031f6c4783f05de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:31.663549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.664192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.665979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1138/2303] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:31 2022] DELETE /identity/v3/projects/a45e6ca883de4c839031f6c4783f05de => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:31.670207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:31.671574 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:31.710398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1166/2304] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:31.728969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473671-322a-4524-a6e4-6c12ea560abc None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:31.730562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-93473671-322a-4524-a6e4-6c12ea560abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:31.745431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93473671-322a-4524-a6e4-6c12ea560abc None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:31.745721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03b5bc-94a0-4723-aaea-267b0b6304a9 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:31.750736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:31.751497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:31.752516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:31.752900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:31.753174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] PATH_INFO: `/v3/users/ab1d7d144e3e4403988e30dffaa8c845` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:31.754143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:31.754459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:31.755064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] PATH_INFO: `/v3/users/b0fa9cf7a3fe4b59913eaa3c7f82b944` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:31.756184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0fa9cf7a3fe4b59913eaa3c7f82b944)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:31.758107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:31.759823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1d7d144e3e4403988e30dffaa8c845)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:31.761676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:31.813764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0fa9cf7a3fe4b59913eaa3c7f82b944'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.821158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1d7d144e3e4403988e30dffaa8c845'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.824552 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0fa9cf7a3fe4b59913eaa3c7f82b944'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.828744 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1d7d144e3e4403988e30dffaa8c845'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.832569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0fa9cf7a3fe4b59913eaa3c7f82b944'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.833549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0fa9cf7a3fe4b59913eaa3c7f82b944'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.834289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f5e7e594-86cb-4aa7-a70e-69a4b78f5752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0fa9cf7a3fe4b59913eaa3c7f82b944'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.837301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1d7d144e3e4403988e30dffaa8c845'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.838070 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1d7d144e3e4403988e30dffaa8c845'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.838853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1d7d144e3e4403988e30dffaa8c845'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:31.853531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1167/2305] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:31 2022] DELETE /identity/v3/users/b0fa9cf7a3fe4b59913eaa3c7f82b944 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:31.858699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47f96-9908-4785-8c1c-dc204a3268e6 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:31.859530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47f96-9908-4785-8c1c-dc204a3268e6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:31.859668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1139/2306] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:31 2022] DELETE /identity/v3/users/ab1d7d144e3e4403988e30dffaa8c845 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:31.859838 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c47f96-9908-4785-8c1c-dc204a3268e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:31.879300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-01c47f96-9908-4785-8c1c-dc204a3268e6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:31.880788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-01c47f96-9908-4785-8c1c-dc204a3268e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:31.942494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1168/2307] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:31.963202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:31.964641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:32.036968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8f50e-7306-48d2-b146-ff3afe32d289 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.042347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8186b-6ae2-4d98-813b-d5bd0b7d70c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.042898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8186b-6ae2-4d98-813b-d5bd0b7d70c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.043183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8186b-6ae2-4d98-813b-d5bd0b7d70c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.043458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8186b-6ae2-4d98-813b-d5bd0b7d70c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.055770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8186b-6ae2-4d98-813b-d5bd0b7d70c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.058350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8186b-6ae2-4d98-813b-d5bd0b7d70c6 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.069453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1140/2308] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:32.292117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c47f96-9908-4785-8c1c-dc204a3268e6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.293665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-01c47f96-9908-4785-8c1c-dc204a3268e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:32.313950 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c47f96-9908-4785-8c1c-dc204a3268e6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.326974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.328460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.328769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.329032 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] PATH_INFO: `/v3/projects/eaad19c9bc4f40d39c9a7932c85dfffa` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.330856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaad19c9bc4f40d39c9a7932c85dfffa)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.332823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.384509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8186b-6ae2-4d98-813b-d5bd0b7d70c6 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.386695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-1eb8186b-6ae2-4d98-813b-d5bd0b7d70c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:32.409126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8186b-6ae2-4d98-813b-d5bd0b7d70c6 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.411239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaad19c9bc4f40d39c9a7932c85dfffa', 'request_id': 'req-c903f49c-9779-474b-a776-ce92cfe81780'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.425589 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaad19c9bc4f40d39c9a7932c85dfffa', 'request_id': 'req-c903f49c-9779-474b-a776-ce92cfe81780'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.439158 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaad19c9bc4f40d39c9a7932c85dfffa', 'request_id': 'req-c903f49c-9779-474b-a776-ce92cfe81780'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.460862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] The token cache is being invalidate because project eaad19c9bc4f40d39c9a7932c85dfffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:32.461237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.461962 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c903f49c-9779-474b-a776-ce92cfe81780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.463890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1169/2309] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:32 2022] DELETE /identity/v3/projects/eaad19c9bc4f40d39c9a7932c85dfffa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:32.468919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151b5af-9b58-4286-8799-2995cb67a4e3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.469216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151b5af-9b58-4286-8799-2995cb67a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.469497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151b5af-9b58-4286-8799-2995cb67a4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.487960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0151b5af-9b58-4286-8799-2995cb67a4e3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:32.489065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0151b5af-9b58-4286-8799-2995cb67a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:32.516749 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.517951 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.518238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.518544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] PATH_INFO: `/v3/projects/a346ba9339234082b4ff275230470977` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.520294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a346ba9339234082b4ff275230470977)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.522948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.551547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1170/2310] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:32.560424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677eb86-2818-4f4d-9df0-416e48297952 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.561682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677eb86-2818-4f4d-9df0-416e48297952 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.561682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677eb86-2818-4f4d-9df0-416e48297952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.582161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d677eb86-2818-4f4d-9df0-416e48297952 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:32.583412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d677eb86-2818-4f4d-9df0-416e48297952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:32.588815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a346ba9339234082b4ff275230470977', 'request_id': 'req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.595427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a346ba9339234082b4ff275230470977', 'request_id': 'req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.601920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a346ba9339234082b4ff275230470977', 'request_id': 'req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.616844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] The token cache is being invalidate because project a346ba9339234082b4ff275230470977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:32.617139 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.617819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e711df5f-7cb2-46ff-9899-2ff62f2a0ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:32.619448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1141/2311] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:32 2022] DELETE /identity/v3/projects/a346ba9339234082b4ff275230470977 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:32.624620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf88e-1bf6-4797-821f-550ee24034c8 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.624991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf88e-1bf6-4797-821f-550ee24034c8 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.625278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaf88e-1bf6-4797-821f-550ee24034c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.645475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2aeaf88e-1bf6-4797-821f-550ee24034c8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:32.646782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2aeaf88e-1bf6-4797-821f-550ee24034c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:32.658781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1171/2312] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:32.658959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1142/2313] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:32.659060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677eb86-2818-4f4d-9df0-416e48297952 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.662937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db3f1-d416-44bc-a8a9-13d57dc42373 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.663239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db3f1-d416-44bc-a8a9-13d57dc42373 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.663524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db3f1-d416-44bc-a8a9-13d57dc42373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.672998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677eb86-2818-4f4d-9df0-416e48297952 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.678023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f3fa-7fe2-4fd1-8f50-0df95e6b616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.678726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f3fa-7fe2-4fd1-8f50-0df95e6b616b admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.679009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f3fa-7fe2-4fd1-8f50-0df95e6b616b admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.679284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2f3fa-7fe2-4fd1-8f50-0df95e6b616b admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.680006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2f3fa-7fe2-4fd1-8f50-0df95e6b616b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:28:32.680317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2f3fa-7fe2-4fd1-8f50-0df95e6b616b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.681916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2f3fa-7fe2-4fd1-8f50-0df95e6b616b admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.684564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-178db3f1-d416-44bc-a8a9-13d57dc42373 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:32.686029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-178db3f1-d416-44bc-a8a9-13d57dc42373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:32.693748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1172/2314] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:28:32.697585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1143/2315] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:32.697964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f3fa-7fe2-4fd1-8f50-0df95e6b616b admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.701325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db3f1-d416-44bc-a8a9-13d57dc42373 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.711255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2f3fa-7fe2-4fd1-8f50-0df95e6b616b admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.712011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db3f1-d416-44bc-a8a9-13d57dc42373 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.716343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ef488-ffd1-4699-9dcc-3cd5bd2d4455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.717030 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ef488-ffd1-4699-9dcc-3cd5bd2d4455 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.717316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ef488-ffd1-4699-9dcc-3cd5bd2d4455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.717583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ef488-ffd1-4699-9dcc-3cd5bd2d4455 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.718336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ef488-ffd1-4699-9dcc-3cd5bd2d4455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.719540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb649b80-cf03-450e-b349-8f210c75b2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.720193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb649b80-cf03-450e-b349-8f210c75b2de admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.720308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ef488-ffd1-4699-9dcc-3cd5bd2d4455 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.720498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb649b80-cf03-450e-b349-8f210c75b2de admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.720797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb649b80-cf03-450e-b349-8f210c75b2de admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.721795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb649b80-cf03-450e-b349-8f210c75b2de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:28:32.722418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb649b80-cf03-450e-b349-8f210c75b2de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.724590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb649b80-cf03-450e-b349-8f210c75b2de admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.739600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1144/2316] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:28:32.744345 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb649b80-cf03-450e-b349-8f210c75b2de admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.752387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1173/2317] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:32 2022] POST /identity/v3/projects => generated 361 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:28:32.755685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb649b80-cf03-450e-b349-8f210c75b2de admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.756360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ef488-ffd1-4699-9dcc-3cd5bd2d4455 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.810880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3fe83-45f4-424a-b929-640c1a3d7211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.811535 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3fe83-45f4-424a-b929-640c1a3d7211 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.811816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3fe83-45f4-424a-b929-640c1a3d7211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.812128 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3fe83-45f4-424a-b929-640c1a3d7211 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.812830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3fe83-45f4-424a-b929-640c1a3d7211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.814739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3fe83-45f4-424a-b929-640c1a3d7211 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.815141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ef488-ffd1-4699-9dcc-3cd5bd2d4455 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.819816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2dae8-4a0e-4c0e-bca8-24e463832e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.820478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2dae8-4a0e-4c0e-bca8-24e463832e7e admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.820763 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2dae8-4a0e-4c0e-bca8-24e463832e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.821039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2dae8-4a0e-4c0e-bca8-24e463832e7e admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.821718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2dae8-4a0e-4c0e-bca8-24e463832e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.823685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2dae8-4a0e-4c0e-bca8-24e463832e7e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.841260 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1145/2318] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:32 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:28:32.848636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1174/2319] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:32 2022] POST /identity/v3/users => generated 281 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:28:32.848782 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3fe83-45f4-424a-b929-640c1a3d7211 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.849683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2dae8-4a0e-4c0e-bca8-24e463832e7e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.859417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2dae8-4a0e-4c0e-bca8-24e463832e7e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.904626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3fe83-45f4-424a-b929-640c1a3d7211 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.909394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093d0c6-7b53-49d1-af8e-a6a571646a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.910059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093d0c6-7b53-49d1-af8e-a6a571646a10 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.910382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093d0c6-7b53-49d1-af8e-a6a571646a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.910662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093d0c6-7b53-49d1-af8e-a6a571646a10 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.911348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093d0c6-7b53-49d1-af8e-a6a571646a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.913251 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093d0c6-7b53-49d1-af8e-a6a571646a10 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.914189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2edb71-4e9b-4dba-9215-390e676e98db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.914885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2edb71-4e9b-4dba-9215-390e676e98db admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.915169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2edb71-4e9b-4dba-9215-390e676e98db admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.915471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2edb71-4e9b-4dba-9215-390e676e98db admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.916225 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2edb71-4e9b-4dba-9215-390e676e98db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.917784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2edb71-4e9b-4dba-9215-390e676e98db admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.927853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1175/2320] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:32.931599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2edb71-4e9b-4dba-9215-390e676e98db admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.933701 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1146/2321] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:32 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:32.938037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093d0c6-7b53-49d1-af8e-a6a571646a10 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.941971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2edb71-4e9b-4dba-9215-390e676e98db admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.946588 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66de00e-0358-4574-a02e-80bcd736dc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.947238 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66de00e-0358-4574-a02e-80bcd736dc79 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.947339 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093d0c6-7b53-49d1-af8e-a6a571646a10 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.947523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66de00e-0358-4574-a02e-80bcd736dc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.947803 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66de00e-0358-4574-a02e-80bcd736dc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.948519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66de00e-0358-4574-a02e-80bcd736dc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.950091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66de00e-0358-4574-a02e-80bcd736dc79 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.951857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57315d-de38-4a8b-9a20-bda1027e390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.952488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57315d-de38-4a8b-9a20-bda1027e390e admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.953342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57315d-de38-4a8b-9a20-bda1027e390e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.953614 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57315d-de38-4a8b-9a20-bda1027e390e admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.954373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57315d-de38-4a8b-9a20-bda1027e390e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.955966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57315d-de38-4a8b-9a20-bda1027e390e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.960273 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1176/2322] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:28:32.964059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66de00e-0358-4574-a02e-80bcd736dc79 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.968258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1147/2323] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:32.969671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57315d-de38-4a8b-9a20-bda1027e390e admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:32.974550 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66de00e-0358-4574-a02e-80bcd736dc79 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.979192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64539c17-29ee-4692-ba35-b7062dbdc94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.980063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539c17-29ee-4692-ba35-b7062dbdc94c admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.980185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57315d-de38-4a8b-9a20-bda1027e390e admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:32.980350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539c17-29ee-4692-ba35-b7062dbdc94c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.980730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64539c17-29ee-4692-ba35-b7062dbdc94c admin admin] PATH_INFO: `/v3/projects/40cb3c7d08584c298bc8ff47660883ef/users/892ebc1f3ebe45b5b9f885b094453fcf/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.985891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d794b-2798-45e5-8ea2-da78e7c5e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:32.986756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d794b-2798-45e5-8ea2-da78e7c5e64e admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:32.987048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d794b-2798-45e5-8ea2-da78e7c5e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:32.987325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d794b-2798-45e5-8ea2-da78e7c5e64e admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:32.988046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d794b-2798-45e5-8ea2-da78e7c5e64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:32.989958 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d794b-2798-45e5-8ea2-da78e7c5e64e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:32.997338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64539c17-29ee-4692-ba35-b7062dbdc94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cb3c7d08584c298bc8ff47660883ef, user_id=892ebc1f3ebe45b5b9f885b094453fcf, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:33.000043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64539c17-29ee-4692-ba35-b7062dbdc94c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:33.005594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1148/2324] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:33.009868 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d794b-2798-45e5-8ea2-da78e7c5e64e admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:33.016783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1177/2325] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:32 2022] PUT /identity/v3/projects/40cb3c7d08584c298bc8ff47660883ef/users/892ebc1f3ebe45b5b9f885b094453fcf/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:33.020428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d794b-2798-45e5-8ea2-da78e7c5e64e admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:33.027634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea925c-a74d-439f-98d1-0c4cdd3831f1 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.027927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea925c-a74d-439f-98d1-0c4cdd3831f1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.028257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea925c-a74d-439f-98d1-0c4cdd3831f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.055559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1dea925c-a74d-439f-98d1-0c4cdd3831f1 None None] MFA Rules not processed for user `892ebc1f3ebe45b5b9f885b094453fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:33.057227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1dea925c-a74d-439f-98d1-0c4cdd3831f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:33.085220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946faa-f14d-4cb3-87e8-9f33feab110c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:33.085960 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946faa-f14d-4cb3-87e8-9f33feab110c admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.086244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946faa-f14d-4cb3-87e8-9f33feab110c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.086583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946faa-f14d-4cb3-87e8-9f33feab110c admin admin] PATH_INFO: `/v3/projects/723b25d67f28409db601ff7a216cface/users/af506c2f031d4e51aa5cc1144f5d36ef/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.111299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12946faa-f14d-4cb3-87e8-9f33feab110c admin admin] RBAC: Authorizing `identity:create_grant(project_id=723b25d67f28409db601ff7a216cface, user_id=af506c2f031d4e51aa5cc1144f5d36ef, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:33.117738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12946faa-f14d-4cb3-87e8-9f33feab110c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:33.133980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1149/2326] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:33 2022] PUT /identity/v3/projects/723b25d67f28409db601ff7a216cface/users/af506c2f031d4e51aa5cc1144f5d36ef/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:33.142477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1178/2327] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:33.148146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e995905-9765-4782-b533-68a57ad57316 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.148865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e995905-9765-4782-b533-68a57ad57316 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.149149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e995905-9765-4782-b533-68a57ad57316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.177007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea925c-a74d-439f-98d1-0c4cdd3831f1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:33.179577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1dea925c-a74d-439f-98d1-0c4cdd3831f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:33.190448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0e995905-9765-4782-b533-68a57ad57316 None None] MFA Rules not processed for user `af506c2f031d4e51aa5cc1144f5d36ef`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:33.195883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0e995905-9765-4782-b533-68a57ad57316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:33.253819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea925c-a74d-439f-98d1-0c4cdd3831f1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:33.277359 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1150/2328] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:33.291401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e995905-9765-4782-b533-68a57ad57316 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:33.293304 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0e995905-9765-4782-b533-68a57ad57316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:33.309986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c56a3-31d7-4e3d-a663-033322bdc48d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:33.310722 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c56a3-31d7-4e3d-a663-033322bdc48d service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.310959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c56a3-31d7-4e3d-a663-033322bdc48d service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.311220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c56a3-31d7-4e3d-a663-033322bdc48d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.353224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e995905-9765-4782-b533-68a57ad57316 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:33.357968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca8b0-ccfc-4572-b789-aa0f88650237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:33.358640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca8b0-ccfc-4572-b789-aa0f88650237 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.359455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca8b0-ccfc-4572-b789-aa0f88650237 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.359730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ca8b0-ccfc-4572-b789-aa0f88650237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.368300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca8b0-ccfc-4572-b789-aa0f88650237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:33.369757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ca8b0-ccfc-4572-b789-aa0f88650237 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:33.372258 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c56a3-31d7-4e3d-a663-033322bdc48d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:33.373812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c56a3-31d7-4e3d-a663-033322bdc48d service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:33.379271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1151/2329] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:33.384919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1179/2330] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:33.403576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca8b0-ccfc-4572-b789-aa0f88650237 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:33.407553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c56a3-31d7-4e3d-a663-033322bdc48d service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:33.466198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ca8b0-ccfc-4572-b789-aa0f88650237 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:33.469556 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c56a3-31d7-4e3d-a663-033322bdc48d service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:33.471380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:33.472475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.472763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.473040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] PATH_INFO: `/v3/users/892ebc1f3ebe45b5b9f885b094453fcf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.474341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=892ebc1f3ebe45b5b9f885b094453fcf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:33.474714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:33.475592 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.475877 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.476277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] PATH_INFO: `/v3/users/af506c2f031d4e51aa5cc1144f5d36ef` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.476354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:33.477354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af506c2f031d4e51aa5cc1144f5d36ef)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:33.479317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:33.532690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892ebc1f3ebe45b5b9f885b094453fcf'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.538152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af506c2f031d4e51aa5cc1144f5d36ef'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.539706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892ebc1f3ebe45b5b9f885b094453fcf'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.546050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af506c2f031d4e51aa5cc1144f5d36ef'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.548084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892ebc1f3ebe45b5b9f885b094453fcf'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.548728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892ebc1f3ebe45b5b9f885b094453fcf'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.549350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-83f4988c-e4b4-4956-b16d-fcda14e01263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892ebc1f3ebe45b5b9f885b094453fcf'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.555101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af506c2f031d4e51aa5cc1144f5d36ef'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.555899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af506c2f031d4e51aa5cc1144f5d36ef'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.556553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-56fc7ed2-e2ef-477d-ac44-66d60308a00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af506c2f031d4e51aa5cc1144f5d36ef'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:33.573130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1152/2331] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:33 2022] DELETE /identity/v3/users/892ebc1f3ebe45b5b9f885b094453fcf => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:33.574042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1180/2332] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:33 2022] DELETE /identity/v3/users/af506c2f031d4e51aa5cc1144f5d36ef => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:33.578342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b0a9-6872-4812-87b8-5aedd0a0c015 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.578782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4a63-e4d9-458c-b966-dc778d84abb8 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.579058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b0a9-6872-4812-87b8-5aedd0a0c015 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.579177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4a63-e4d9-458c-b966-dc778d84abb8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.579341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c4a63-e4d9-458c-b966-dc778d84abb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.579824 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195b0a9-6872-4812-87b8-5aedd0a0c015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.597463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d195b0a9-6872-4812-87b8-5aedd0a0c015 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:33.597824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-409c4a63-e4d9-458c-b966-dc778d84abb8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:33.598694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d195b0a9-6872-4812-87b8-5aedd0a0c015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:33.599006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-409c4a63-e4d9-458c-b966-dc778d84abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:33.655596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1181/2333] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:33.660514 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1153/2334] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:33.666786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4a63-e4d9-458c-b966-dc778d84abb8 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:33.668629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-409c4a63-e4d9-458c-b966-dc778d84abb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:33.674945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b0a9-6872-4812-87b8-5aedd0a0c015 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:33.676399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d195b0a9-6872-4812-87b8-5aedd0a0c015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:33.727661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c4a63-e4d9-458c-b966-dc778d84abb8 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:33.731237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f6456-bcfc-497b-adde-14738541d8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:33.731883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f6456-bcfc-497b-adde-14738541d8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.732246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f6456-bcfc-497b-adde-14738541d8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.732521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f6456-bcfc-497b-adde-14738541d8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.743323 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f6456-bcfc-497b-adde-14738541d8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:33.743881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195b0a9-6872-4812-87b8-5aedd0a0c015 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:33.744949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f6456-bcfc-497b-adde-14738541d8c0 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:33.747694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3734b1e-654d-4fc3-b3df-95d409c15c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:33.748348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734b1e-654d-4fc3-b3df-95d409c15c45 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:33.748630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734b1e-654d-4fc3-b3df-95d409c15c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:33.748905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734b1e-654d-4fc3-b3df-95d409c15c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:33.756482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1182/2335] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:33.759211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3734b1e-654d-4fc3-b3df-95d409c15c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:33.760640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3734b1e-654d-4fc3-b3df-95d409c15c45 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:33.770987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1154/2336] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:28:34.074513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f6456-bcfc-497b-adde-14738541d8c0 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.076584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c89f6456-bcfc-497b-adde-14738541d8c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:34.092593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f6456-bcfc-497b-adde-14738541d8c0 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.098143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.099458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.099458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.099690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] PATH_INFO: `/v3/projects/40cb3c7d08584c298bc8ff47660883ef` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.101612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40cb3c7d08584c298bc8ff47660883ef)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.104098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.152350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40cb3c7d08584c298bc8ff47660883ef', 'request_id': 'req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.159669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40cb3c7d08584c298bc8ff47660883ef', 'request_id': 'req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.166149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40cb3c7d08584c298bc8ff47660883ef', 'request_id': 'req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.177239 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] The token cache is being invalidate because project 40cb3c7d08584c298bc8ff47660883ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:34.177454 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.178098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-f8ee6aa5-15d1-40f2-a8f2-e8ee08caf224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.180108 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1183/2337] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:34 2022] DELETE /identity/v3/projects/40cb3c7d08584c298bc8ff47660883ef => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:34.185006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a156b-e5f2-4021-8df5-65fbc22e0f78 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.185294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a156b-e5f2-4021-8df5-65fbc22e0f78 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.185568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a156b-e5f2-4021-8df5-65fbc22e0f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.204052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-c72a156b-e5f2-4021-8df5-65fbc22e0f78 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:34.205379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c72a156b-e5f2-4021-8df5-65fbc22e0f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:34.271203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1155/2338] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:34.279285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21b38-b0a4-4861-b2d7-527c3151cae8 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.279285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21b38-b0a4-4861-b2d7-527c3151cae8 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.279285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a21b38-b0a4-4861-b2d7-527c3151cae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.308707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-a7a21b38-b0a4-4861-b2d7-527c3151cae8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:34.310066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a7a21b38-b0a4-4861-b2d7-527c3151cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:34.323375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a156b-e5f2-4021-8df5-65fbc22e0f78 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.324798 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c72a156b-e5f2-4021-8df5-65fbc22e0f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:34.329830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1184/2339] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:34.333979 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21b38-b0a4-4861-b2d7-527c3151cae8 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.343095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a156b-e5f2-4021-8df5-65fbc22e0f78 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.360251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a21b38-b0a4-4861-b2d7-527c3151cae8 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.366620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.367692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.368760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.369034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] PATH_INFO: `/v3/projects/723b25d67f28409db601ff7a216cface` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.370497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723b25d67f28409db601ff7a216cface)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.373217 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.378685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4774f98-d675-431d-8b9e-e6494cee6a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.379700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4774f98-d675-431d-8b9e-e6494cee6a13 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.381043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4774f98-d675-431d-8b9e-e6494cee6a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.381582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4774f98-d675-431d-8b9e-e6494cee6a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.382576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4774f98-d675-431d-8b9e-e6494cee6a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:28:34.387253 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4774f98-d675-431d-8b9e-e6494cee6a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.392249 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4774f98-d675-431d-8b9e-e6494cee6a13 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.408077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1185/2340] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:28:34.415280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4774f98-d675-431d-8b9e-e6494cee6a13 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.427372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4774f98-d675-431d-8b9e-e6494cee6a13 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.441678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723b25d67f28409db601ff7a216cface', 'request_id': 'req-fa1206e5-120a-4c00-8aae-c4cf016fa531'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.448134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723b25d67f28409db601ff7a216cface', 'request_id': 'req-fa1206e5-120a-4c00-8aae-c4cf016fa531'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.455119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723b25d67f28409db601ff7a216cface', 'request_id': 'req-fa1206e5-120a-4c00-8aae-c4cf016fa531'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.473090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] The token cache is being invalidate because project 723b25d67f28409db601ff7a216cface was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:34.473518 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.474474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-fa1206e5-120a-4c00-8aae-c4cf016fa531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:34.479208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1156/2341] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:34 2022] DELETE /identity/v3/projects/723b25d67f28409db601ff7a216cface => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:34.481152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f857c-f06e-47c4-9f02-05aa811a48da None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.481618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f857c-f06e-47c4-9f02-05aa811a48da None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.482082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f857c-f06e-47c4-9f02-05aa811a48da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.503653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afdeb6-45ae-4a9c-9d49-df3320882e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.504651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afdeb6-45ae-4a9c-9d49-df3320882e50 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.505457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afdeb6-45ae-4a9c-9d49-df3320882e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.508335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2c7f857c-f06e-47c4-9f02-05aa811a48da None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:34.509519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2c7f857c-f06e-47c4-9f02-05aa811a48da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:34.510416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afdeb6-45ae-4a9c-9d49-df3320882e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.511569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afdeb6-45ae-4a9c-9d49-df3320882e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.513926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4afdeb6-45ae-4a9c-9d49-df3320882e50 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.522416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1157/2342] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:34.531948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16220ac-9638-40a8-a358-2c3b998409fd None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.532586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16220ac-9638-40a8-a358-2c3b998409fd None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.532706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16220ac-9638-40a8-a358-2c3b998409fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.547878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1186/2343] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:34 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:34.552407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afdeb6-45ae-4a9c-9d49-df3320882e50 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.555547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c4afdeb6-45ae-4a9c-9d49-df3320882e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:34.557864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a16220ac-9638-40a8-a358-2c3b998409fd None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:34.559542 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a16220ac-9638-40a8-a358-2c3b998409fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:34.647693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1158/2344] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:34.652739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16220ac-9638-40a8-a358-2c3b998409fd None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.663564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16220ac-9638-40a8-a358-2c3b998409fd None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.670878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4afdeb6-45ae-4a9c-9d49-df3320882e50 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.678794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b147677-8946-41b9-b00d-2c920e07d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.680444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b147677-8946-41b9-b00d-2c920e07d844 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.681513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b147677-8946-41b9-b00d-2c920e07d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.682587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f79a8b-646a-4fc0-a8bd-4800e8d7ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.683340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f79a8b-646a-4fc0-a8bd-4800e8d7ae10 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.683727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f79a8b-646a-4fc0-a8bd-4800e8d7ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.684211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f79a8b-646a-4fc0-a8bd-4800e8d7ae10 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.684984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f79a8b-646a-4fc0-a8bd-4800e8d7ae10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.685377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b147677-8946-41b9-b00d-2c920e07d844 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.686213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b147677-8946-41b9-b00d-2c920e07d844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:28:34.688686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b147677-8946-41b9-b00d-2c920e07d844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.690523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b147677-8946-41b9-b00d-2c920e07d844 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.691295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f79a8b-646a-4fc0-a8bd-4800e8d7ae10 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.718034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1159/2345] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:28:34.719750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b147677-8946-41b9-b00d-2c920e07d844 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.723958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1187/2346] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:34 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:28:34.727927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f79a8b-646a-4fc0-a8bd-4800e8d7ae10 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.731049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b147677-8946-41b9-b00d-2c920e07d844 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.736814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead01bb3-696e-475a-a072-0e6c3d4a7c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.737780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead01bb3-696e-475a-a072-0e6c3d4a7c1f admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.738096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead01bb3-696e-475a-a072-0e6c3d4a7c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.738414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead01bb3-696e-475a-a072-0e6c3d4a7c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.739119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead01bb3-696e-475a-a072-0e6c3d4a7c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.741031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead01bb3-696e-475a-a072-0e6c3d4a7c1f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.746316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f79a8b-646a-4fc0-a8bd-4800e8d7ae10 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.751782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6531a1b-4aba-49a5-bcff-af9988fa38df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.752609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6531a1b-4aba-49a5-bcff-af9988fa38df admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.753350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6531a1b-4aba-49a5-bcff-af9988fa38df admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.753350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6531a1b-4aba-49a5-bcff-af9988fa38df admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.754271 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6531a1b-4aba-49a5-bcff-af9988fa38df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.756920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6531a1b-4aba-49a5-bcff-af9988fa38df admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.770712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1188/2347] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:28:34.774461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6531a1b-4aba-49a5-bcff-af9988fa38df admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.777682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1160/2348] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:34 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:34.782114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead01bb3-696e-475a-a072-0e6c3d4a7c1f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.788461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6531a1b-4aba-49a5-bcff-af9988fa38df admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.869367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead01bb3-696e-475a-a072-0e6c3d4a7c1f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.869834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4c16-a5c6-44d1-b0f0-a5adee33b8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.870559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4c16-a5c6-44d1-b0f0-a5adee33b8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.870839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4c16-a5c6-44d1-b0f0-a5adee33b8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.871134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d4c16-a5c6-44d1-b0f0-a5adee33b8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.871890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d4c16-a5c6-44d1-b0f0-a5adee33b8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.873522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d4c16-a5c6-44d1-b0f0-a5adee33b8a5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.878612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5b938-8192-498f-9967-84ce9315eb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.879413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b938-8192-498f-9967-84ce9315eb02 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.880235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b938-8192-498f-9967-84ce9315eb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.880235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5b938-8192-498f-9967-84ce9315eb02 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.880946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5b938-8192-498f-9967-84ce9315eb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.883581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d5b938-8192-498f-9967-84ce9315eb02 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.886908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1189/2349] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:28:34.888001 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4c16-a5c6-44d1-b0f0-a5adee33b8a5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.902141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d4c16-a5c6-44d1-b0f0-a5adee33b8a5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.917025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1161/2350] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:34 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:34.918063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5856f5e-174f-4a6f-80ba-f4ecb5b5ef8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.919335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5b938-8192-498f-9967-84ce9315eb02 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.919640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5856f5e-174f-4a6f-80ba-f4ecb5b5ef8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.919843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5856f5e-174f-4a6f-80ba-f4ecb5b5ef8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.920148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5856f5e-174f-4a6f-80ba-f4ecb5b5ef8b admin admin] PATH_INFO: `/v3/projects/5a9f7a48248e43dda4344512f232f005/users/6becc730c84b4c769288e60069033c84/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.929698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d5b938-8192-498f-9967-84ce9315eb02 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.934689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a24fd5-682d-4730-b7e7-13dd83b2dd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:34.935348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24fd5-682d-4730-b7e7-13dd83b2dd08 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.935628 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24fd5-682d-4730-b7e7-13dd83b2dd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.935897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24fd5-682d-4730-b7e7-13dd83b2dd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.936053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5856f5e-174f-4a6f-80ba-f4ecb5b5ef8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9f7a48248e43dda4344512f232f005, user_id=6becc730c84b4c769288e60069033c84, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.936617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a24fd5-682d-4730-b7e7-13dd83b2dd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:34.938292 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a24fd5-682d-4730-b7e7-13dd83b2dd08 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.939570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5856f5e-174f-4a6f-80ba-f4ecb5b5ef8b admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:34.949561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1162/2351] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:34.953719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a24fd5-682d-4730-b7e7-13dd83b2dd08 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:34.959161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1190/2352] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:34 2022] PUT /identity/v3/projects/5a9f7a48248e43dda4344512f232f005/users/6becc730c84b4c769288e60069033c84/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:34.966492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef60eff-ac36-4ac2-8a9f-149212f56bed None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:34.966788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef60eff-ac36-4ac2-8a9f-149212f56bed None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:34.967071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef60eff-ac36-4ac2-8a9f-149212f56bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:34.967382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a24fd5-682d-4730-b7e7-13dd83b2dd08 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:34.998105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-fef60eff-ac36-4ac2-8a9f-149212f56bed None None] MFA Rules not processed for user `6becc730c84b4c769288e60069033c84`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:34.999427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fef60eff-ac36-4ac2-8a9f-149212f56bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:35.037162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12997e5-7df2-43df-a271-721ce9d4164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:35.038097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12997e5-7df2-43df-a271-721ce9d4164a admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:35.038596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12997e5-7df2-43df-a271-721ce9d4164a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:35.038874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12997e5-7df2-43df-a271-721ce9d4164a admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:35.039603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12997e5-7df2-43df-a271-721ce9d4164a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:35.041383 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12997e5-7df2-43df-a271-721ce9d4164a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:35.056875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1163/2353] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:28:35.058212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12997e5-7df2-43df-a271-721ce9d4164a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:35.069405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12997e5-7df2-43df-a271-721ce9d4164a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:35.074479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1191/2354] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:35.078188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbbe2e-1eac-4c43-be1c-a5fbe59613fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:35.078881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbe2e-1eac-4c43-be1c-a5fbe59613fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:35.079167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbe2e-1eac-4c43-be1c-a5fbe59613fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:35.079446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbbe2e-1eac-4c43-be1c-a5fbe59613fc admin admin] PATH_INFO: `/v3/projects/0a62be94e0264615ba080586866da228/users/3dd900304ee74e97b18ec150ac97a43a/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:35.098405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbbe2e-1eac-4c43-be1c-a5fbe59613fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a62be94e0264615ba080586866da228, user_id=3dd900304ee74e97b18ec150ac97a43a, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:35.098528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef60eff-ac36-4ac2-8a9f-149212f56bed None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:35.099842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fef60eff-ac36-4ac2-8a9f-149212f56bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:35.101418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbbe2e-1eac-4c43-be1c-a5fbe59613fc admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:35.115522 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1164/2355] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:35 2022] PUT /identity/v3/projects/0a62be94e0264615ba080586866da228/users/3dd900304ee74e97b18ec150ac97a43a/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:35.127079 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7319427-2fd9-4226-aad9-51e9a1d18a3b None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:35.127693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7319427-2fd9-4226-aad9-51e9a1d18a3b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:35.128117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7319427-2fd9-4226-aad9-51e9a1d18a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:35.156620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e7319427-2fd9-4226-aad9-51e9a1d18a3b None None] MFA Rules not processed for user `3dd900304ee74e97b18ec150ac97a43a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:35.157831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e7319427-2fd9-4226-aad9-51e9a1d18a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:35.160395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef60eff-ac36-4ac2-8a9f-149212f56bed None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:35.216889 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14101b5b-e2b3-4ec0-b7c8-2b06d7e08fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:35.217549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101b5b-e2b3-4ec0-b7c8-2b06d7e08fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:35.217836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101b5b-e2b3-4ec0-b7c8-2b06d7e08fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:35.218646 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14101b5b-e2b3-4ec0-b7c8-2b06d7e08fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:35.224529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1165/2356] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:35.235579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7319427-2fd9-4226-aad9-51e9a1d18a3b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:35.237074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e7319427-2fd9-4226-aad9-51e9a1d18a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:35.249107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7319427-2fd9-4226-aad9-51e9a1d18a3b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:35.253488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecbb11-801e-4d95-9688-5d2f1aab6b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:35.254643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecbb11-801e-4d95-9688-5d2f1aab6b2c service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:35.254643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecbb11-801e-4d95-9688-5d2f1aab6b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:35.255034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecbb11-801e-4d95-9688-5d2f1aab6b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:35.263607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecbb11-801e-4d95-9688-5d2f1aab6b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:35.265747 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecbb11-801e-4d95-9688-5d2f1aab6b2c service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:35.275326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1166/2357] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:28:35.283687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14101b5b-e2b3-4ec0-b7c8-2b06d7e08fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:35.285216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14101b5b-e2b3-4ec0-b7c8-2b06d7e08fd9 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:35.294634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1192/2358] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:38.322272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecbb11-801e-4d95-9688-5d2f1aab6b2c service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:38.384368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecbb11-801e-4d95-9688-5d2f1aab6b2c service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:38.390741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:38.391868 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:38.392188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:38.392454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] PATH_INFO: `/v3/users/6becc730c84b4c769288e60069033c84` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:38.394276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=6becc730c84b4c769288e60069033c84)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:38.396486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:38.461192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6becc730c84b4c769288e60069033c84'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:38.469005 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6becc730c84b4c769288e60069033c84'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:38.477502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6becc730c84b4c769288e60069033c84'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:38.478133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6becc730c84b4c769288e60069033c84'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:38.478876 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6becc730c84b4c769288e60069033c84'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:38.495723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1167/2359] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:38 2022] DELETE /identity/v3/users/6becc730c84b4c769288e60069033c84 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:38.500375 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437582-31ca-434c-a980-1dd0e2b638e1 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:38.500890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437582-31ca-434c-a980-1dd0e2b638e1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:38.501095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc437582-31ca-434c-a980-1dd0e2b638e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:38.518627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-dc437582-31ca-434c-a980-1dd0e2b638e1 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:38.519839 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-dc437582-31ca-434c-a980-1dd0e2b638e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:38.577349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1193/2360] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:38.587433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:38.589975 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:38.646878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255b9e4-53fb-42f0-a523-eb45c3ad3afe admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:38.650762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d69de-803d-4477-b534-b330314ed865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:38.651415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d69de-803d-4477-b534-b330314ed865 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:38.651700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d69de-803d-4477-b534-b330314ed865 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:38.652010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d69de-803d-4477-b534-b330314ed865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:38.661938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d69de-803d-4477-b534-b330314ed865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:38.663532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d69de-803d-4477-b534-b330314ed865 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:38.674216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1168/2361] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:38.941465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc437582-31ca-434c-a980-1dd0e2b638e1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:38.942937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-dc437582-31ca-434c-a980-1dd0e2b638e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:38.957854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc437582-31ca-434c-a980-1dd0e2b638e1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:38.962596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:38.963460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:38.963853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:38.964138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] PATH_INFO: `/v3/projects/5a9f7a48248e43dda4344512f232f005` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:38.965309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9f7a48248e43dda4344512f232f005)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:38.967262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:39.012153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9f7a48248e43dda4344512f232f005', 'request_id': 'req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:39.019368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9f7a48248e43dda4344512f232f005', 'request_id': 'req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:39.025521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9f7a48248e43dda4344512f232f005', 'request_id': 'req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:39.035360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] The token cache is being invalidate because project 5a9f7a48248e43dda4344512f232f005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:39.035645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:39.036267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1c53fbfc-b50f-4a59-adf9-ea6e5bd72fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:39.037784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1194/2362] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:38 2022] DELETE /identity/v3/projects/5a9f7a48248e43dda4344512f232f005 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:39.042556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117e109-37bf-4a48-9e15-a2ca40b8a95a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.042850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117e109-37bf-4a48-9e15-a2ca40b8a95a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.043133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117e109-37bf-4a48-9e15-a2ca40b8a95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.060029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e117e109-37bf-4a48-9e15-a2ca40b8a95a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:39.061215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e117e109-37bf-4a48-9e15-a2ca40b8a95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:39.120026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1169/2363] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:39.128336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6ce9-cc93-4b67-bacf-fae8aef5ced9 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.128625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6ce9-cc93-4b67-bacf-fae8aef5ced9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.128903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf6ce9-cc93-4b67-bacf-fae8aef5ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.149293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5baf6ce9-cc93-4b67-bacf-fae8aef5ced9 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:39.150517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5baf6ce9-cc93-4b67-bacf-fae8aef5ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:39.158644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1195/2364] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:39.162801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117e109-37bf-4a48-9e15-a2ca40b8a95a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:39.172254 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117e109-37bf-4a48-9e15-a2ca40b8a95a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:39.176980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424471e-3f32-45e9-8198-8c263bac6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:39.177654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424471e-3f32-45e9-8198-8c263bac6b84 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.177926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424471e-3f32-45e9-8198-8c263bac6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.178200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424471e-3f32-45e9-8198-8c263bac6b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.178972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424471e-3f32-45e9-8198-8c263bac6b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:28:39.179281 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424471e-3f32-45e9-8198-8c263bac6b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:39.180902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424471e-3f32-45e9-8198-8c263bac6b84 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:39.196279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1170/2365] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:28:39.197342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6ce9-cc93-4b67-bacf-fae8aef5ced9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:39.206653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf6ce9-cc93-4b67-bacf-fae8aef5ced9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:39.211384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41452bea-335e-462c-ad49-c21d9e5d6c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:39.212101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41452bea-335e-462c-ad49-c21d9e5d6c8e admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.212450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41452bea-335e-462c-ad49-c21d9e5d6c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.212790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41452bea-335e-462c-ad49-c21d9e5d6c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.213563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41452bea-335e-462c-ad49-c21d9e5d6c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:39.215530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41452bea-335e-462c-ad49-c21d9e5d6c8e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:39.245534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1196/2366] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:39 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:39.246785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424471e-3f32-45e9-8198-8c263bac6b84 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:39.257971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424471e-3f32-45e9-8198-8c263bac6b84 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:39.320029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51e6a8-a8ae-4f70-b994-23fdc282391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:39.320699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e6a8-a8ae-4f70-b994-23fdc282391e admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.320977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e6a8-a8ae-4f70-b994-23fdc282391e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.321248 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51e6a8-a8ae-4f70-b994-23fdc282391e admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.321928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51e6a8-a8ae-4f70-b994-23fdc282391e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:39.323867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51e6a8-a8ae-4f70-b994-23fdc282391e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:39.344516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1171/2367] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:39 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:39.348612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41452bea-335e-462c-ad49-c21d9e5d6c8e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:39.358573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41452bea-335e-462c-ad49-c21d9e5d6c8e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:39.363984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f980-3604-4aec-ae5b-a31c6dfdce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:39.364649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f980-3604-4aec-ae5b-a31c6dfdce67 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.364934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f980-3604-4aec-ae5b-a31c6dfdce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.365204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27f980-3604-4aec-ae5b-a31c6dfdce67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.365929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27f980-3604-4aec-ae5b-a31c6dfdce67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:39.367572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27f980-3604-4aec-ae5b-a31c6dfdce67 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:39.378458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1197/2368] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:39.382692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51e6a8-a8ae-4f70-b994-23fdc282391e admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:39.392726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51e6a8-a8ae-4f70-b994-23fdc282391e admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:39.397855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b2947-226a-44c8-8dd3-4cdd5d09bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:39.398919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b2947-226a-44c8-8dd3-4cdd5d09bade admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.399285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b2947-226a-44c8-8dd3-4cdd5d09bade admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.399564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b2947-226a-44c8-8dd3-4cdd5d09bade admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.400293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b2947-226a-44c8-8dd3-4cdd5d09bade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:39.402019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b2947-226a-44c8-8dd3-4cdd5d09bade admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:39.415287 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1172/2369] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:28:39.419391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f980-3604-4aec-ae5b-a31c6dfdce67 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:39.431282 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27f980-3604-4aec-ae5b-a31c6dfdce67 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:39.437892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01163c-f5cb-4607-9b51-cd6fe2beb2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:39.438857 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01163c-f5cb-4607-9b51-cd6fe2beb2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.439195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01163c-f5cb-4607-9b51-cd6fe2beb2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.439478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01163c-f5cb-4607-9b51-cd6fe2beb2b5 admin admin] PATH_INFO: `/v3/projects/818b3fdb2b0045769c9ceebf24f0987f/users/76d125fe0e0046cbaaa29f484d1c4bb8/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.459308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01163c-f5cb-4607-9b51-cd6fe2beb2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818b3fdb2b0045769c9ceebf24f0987f, user_id=76d125fe0e0046cbaaa29f484d1c4bb8, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:39.462569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01163c-f5cb-4607-9b51-cd6fe2beb2b5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:39.484175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1198/2370] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:39 2022] PUT /identity/v3/projects/818b3fdb2b0045769c9ceebf24f0987f/users/76d125fe0e0046cbaaa29f484d1c4bb8/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:39.495154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc539b-f124-44f3-9e04-27435d8dacab None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.495460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc539b-f124-44f3-9e04-27435d8dacab None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.495719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc539b-f124-44f3-9e04-27435d8dacab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.668868 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-9bdc539b-f124-44f3-9e04-27435d8dacab None None] MFA Rules not processed for user `76d125fe0e0046cbaaa29f484d1c4bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:39.670198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9bdc539b-f124-44f3-9e04-27435d8dacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:39.757506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1173/2371] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:39.763043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01163c-f5cb-4607-9b51-cd6fe2beb2b5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:39.830408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01163c-f5cb-4607-9b51-cd6fe2beb2b5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:39.835148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38aad9-e549-4bee-ab50-4f8f93c18036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:39.835796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38aad9-e549-4bee-ab50-4f8f93c18036 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.836074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38aad9-e549-4bee-ab50-4f8f93c18036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.836344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38aad9-e549-4bee-ab50-4f8f93c18036 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.837019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38aad9-e549-4bee-ab50-4f8f93c18036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:39.838928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38aad9-e549-4bee-ab50-4f8f93c18036 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:39.863885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1199/2372] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:39 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:39.868618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc539b-f124-44f3-9e04-27435d8dacab None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:39.880229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc539b-f124-44f3-9e04-27435d8dacab None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:39.945464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66d9d-8a5a-4227-ad99-195e1b56ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:39.946136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66d9d-8a5a-4227-ad99-195e1b56ff92 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.946458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66d9d-8a5a-4227-ad99-195e1b56ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.946735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66d9d-8a5a-4227-ad99-195e1b56ff92 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.947419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded66d9d-8a5a-4227-ad99-195e1b56ff92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:39.949321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded66d9d-8a5a-4227-ad99-195e1b56ff92 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:39.970867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1174/2373] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:39 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:39.974935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38aad9-e549-4bee-ab50-4f8f93c18036 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:39.985950 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38aad9-e549-4bee-ab50-4f8f93c18036 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:39.990895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7e75a-a938-406f-8f40-c450d7dedc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:39.991802 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7e75a-a938-406f-8f40-c450d7dedc1b admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:39.992335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7e75a-a938-406f-8f40-c450d7dedc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:39.992658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7e75a-a938-406f-8f40-c450d7dedc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:39.993597 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7e75a-a938-406f-8f40-c450d7dedc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:39.996319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7e75a-a938-406f-8f40-c450d7dedc1b admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.008042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1200/2374] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:40.012650 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66d9d-8a5a-4227-ad99-195e1b56ff92 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:40.023540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded66d9d-8a5a-4227-ad99-195e1b56ff92 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:40.028216 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8af64-0ad1-4b4e-a5d2-a1cf2ae1f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:40.028902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8af64-0ad1-4b4e-a5d2-a1cf2ae1f262 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.029180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8af64-0ad1-4b4e-a5d2-a1cf2ae1f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.029450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8af64-0ad1-4b4e-a5d2-a1cf2ae1f262 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.030191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8af64-0ad1-4b4e-a5d2-a1cf2ae1f262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:40.032519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8af64-0ad1-4b4e-a5d2-a1cf2ae1f262 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.044158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1175/2375] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:40.048541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7e75a-a938-406f-8f40-c450d7dedc1b admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:40.059126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7e75a-a938-406f-8f40-c450d7dedc1b admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:40.063985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53324c2f-dd63-4871-a269-44c76b0406ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:40.064953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53324c2f-dd63-4871-a269-44c76b0406ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.065334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53324c2f-dd63-4871-a269-44c76b0406ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.065614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53324c2f-dd63-4871-a269-44c76b0406ce admin admin] PATH_INFO: `/v3/projects/1587d6bb45754c7bb763c48daa9c6421/users/057908f9874149edb504cded02dd4c52/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.081994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53324c2f-dd63-4871-a269-44c76b0406ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1587d6bb45754c7bb763c48daa9c6421, user_id=057908f9874149edb504cded02dd4c52, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:40.084724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53324c2f-dd63-4871-a269-44c76b0406ce admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.099498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1201/2376] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:40 2022] PUT /identity/v3/projects/1587d6bb45754c7bb763c48daa9c6421/users/057908f9874149edb504cded02dd4c52/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:40.110691 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff0e9-26e7-4023-ab64-db6e5721e544 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.110995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff0e9-26e7-4023-ab64-db6e5721e544 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.111271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff0e9-26e7-4023-ab64-db6e5721e544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.139529 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-065ff0e9-26e7-4023-ab64-db6e5721e544 None None] MFA Rules not processed for user `057908f9874149edb504cded02dd4c52`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:40.143891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-065ff0e9-26e7-4023-ab64-db6e5721e544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:40.205515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1176/2377] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:40.209994 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53324c2f-dd63-4871-a269-44c76b0406ce admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:40.269214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53324c2f-dd63-4871-a269-44c76b0406ce admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:40.274106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679622b9-6a42-4910-8614-7e89403527da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:40.274778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679622b9-6a42-4910-8614-7e89403527da admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.275063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679622b9-6a42-4910-8614-7e89403527da admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.275338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679622b9-6a42-4910-8614-7e89403527da admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.276022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679622b9-6a42-4910-8614-7e89403527da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:40.277909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679622b9-6a42-4910-8614-7e89403527da admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.303497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1202/2378] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:40 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:28:40.307328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ff0e9-26e7-4023-ab64-db6e5721e544 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:40.317594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ff0e9-26e7-4023-ab64-db6e5721e544 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:40.373342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b03a27-7dfa-40c3-bf40-ec23ada73c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:40.374027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03a27-7dfa-40c3-bf40-ec23ada73c98 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.374860 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03a27-7dfa-40c3-bf40-ec23ada73c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.375138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b03a27-7dfa-40c3-bf40-ec23ada73c98 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.375811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b03a27-7dfa-40c3-bf40-ec23ada73c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:40.377703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b03a27-7dfa-40c3-bf40-ec23ada73c98 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.397456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1177/2379] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:40 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:40.401840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679622b9-6a42-4910-8614-7e89403527da admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:40.411938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679622b9-6a42-4910-8614-7e89403527da admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:40.416624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc80e8-ea60-4c35-a479-8a5722420331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:40.417279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc80e8-ea60-4c35-a479-8a5722420331 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.417568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc80e8-ea60-4c35-a479-8a5722420331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.417842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc80e8-ea60-4c35-a479-8a5722420331 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.418595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc80e8-ea60-4c35-a479-8a5722420331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:40.420192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc80e8-ea60-4c35-a479-8a5722420331 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.431171 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1203/2380] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:40.435000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b03a27-7dfa-40c3-bf40-ec23ada73c98 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:40.444943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b03a27-7dfa-40c3-bf40-ec23ada73c98 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:40.449526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bbea1-8260-49fd-9933-ba626cfda875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:40.450495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bbea1-8260-49fd-9933-ba626cfda875 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.450804 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bbea1-8260-49fd-9933-ba626cfda875 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.451083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bbea1-8260-49fd-9933-ba626cfda875 admin admin] PATH_INFO: `/v3/projects/0eb92e6bd32f4f87847443ea07deba15/users/9cc96e6475674c79bf4bc7945beb3645/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.465165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bbea1-8260-49fd-9933-ba626cfda875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb92e6bd32f4f87847443ea07deba15, user_id=9cc96e6475674c79bf4bc7945beb3645, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:40.467830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bbea1-8260-49fd-9933-ba626cfda875 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.480750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1178/2381] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:40 2022] PUT /identity/v3/projects/0eb92e6bd32f4f87847443ea07deba15/users/9cc96e6475674c79bf4bc7945beb3645/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:40.484671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc80e8-ea60-4c35-a479-8a5722420331 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:40.494166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc80e8-ea60-4c35-a479-8a5722420331 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:40.551343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fcc25-a959-4377-a698-6b8777febe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:40.552075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fcc25-a959-4377-a698-6b8777febe39 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.552392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fcc25-a959-4377-a698-6b8777febe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.552724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fcc25-a959-4377-a698-6b8777febe39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.553447 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fcc25-a959-4377-a698-6b8777febe39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:40.555053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fcc25-a959-4377-a698-6b8777febe39 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.564832 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1204/2382] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:40.569269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bbea1-8260-49fd-9933-ba626cfda875 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:40.579875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bbea1-8260-49fd-9933-ba626cfda875 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:40.584485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e77b8-f31f-4a2a-9c39-3faa4f31823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:40.585348 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e77b8-f31f-4a2a-9c39-3faa4f31823c admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.585629 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e77b8-f31f-4a2a-9c39-3faa4f31823c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.585924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e77b8-f31f-4a2a-9c39-3faa4f31823c admin admin] PATH_INFO: `/v3/projects/0eb92e6bd32f4f87847443ea07deba15/users/9cc96e6475674c79bf4bc7945beb3645/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.587885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e77b8-f31f-4a2a-9c39-3faa4f31823c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb92e6bd32f4f87847443ea07deba15, user_id=9cc96e6475674c79bf4bc7945beb3645, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:40.590544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e77b8-f31f-4a2a-9c39-3faa4f31823c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.600485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1179/2383] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:40 2022] PUT /identity/v3/projects/0eb92e6bd32f4f87847443ea07deba15/users/9cc96e6475674c79bf4bc7945beb3645/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:40.610831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd6007-2652-499b-90d8-29cf25bf2b19 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.611125 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd6007-2652-499b-90d8-29cf25bf2b19 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.611404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd6007-2652-499b-90d8-29cf25bf2b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.636831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ebbd6007-2652-499b-90d8-29cf25bf2b19 None None] MFA Rules not processed for user `9cc96e6475674c79bf4bc7945beb3645`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:40.638048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ebbd6007-2652-499b-90d8-29cf25bf2b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:40.704638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1205/2384] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:40.715728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e77b8-f31f-4a2a-9c39-3faa4f31823c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:40.717413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bb3e77b8-f31f-4a2a-9c39-3faa4f31823c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:40.771589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e77b8-f31f-4a2a-9c39-3faa4f31823c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:40.775525 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90ddeb-029f-4795-94b1-4a1302b320dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:40.776157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90ddeb-029f-4795-94b1-4a1302b320dc service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:40.776446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90ddeb-029f-4795-94b1-4a1302b320dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:40.776716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90ddeb-029f-4795-94b1-4a1302b320dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:40.830511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90ddeb-029f-4795-94b1-4a1302b320dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:40.831968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90ddeb-029f-4795-94b1-4a1302b320dc service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:40.840610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1180/2385] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:42.598141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd6007-2652-499b-90d8-29cf25bf2b19 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:42.600359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ebbd6007-2652-499b-90d8-29cf25bf2b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:42.617115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd6007-2652-499b-90d8-29cf25bf2b19 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:42.621672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478370cc-b1a6-44c1-8e8b-df6325ef8bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:42.622468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478370cc-b1a6-44c1-8e8b-df6325ef8bef service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:42.622805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478370cc-b1a6-44c1-8e8b-df6325ef8bef service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:42.623233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478370cc-b1a6-44c1-8e8b-df6325ef8bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:42.693060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478370cc-b1a6-44c1-8e8b-df6325ef8bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:42.694855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478370cc-b1a6-44c1-8e8b-df6325ef8bef service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:42.717007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1206/2386] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:43.413393 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90ddeb-029f-4795-94b1-4a1302b320dc service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:43.422141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90ddeb-029f-4795-94b1-4a1302b320dc service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:43.426044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1badb04-6de1-4e8c-98a9-5a7224a329c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:43.426547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1badb04-6de1-4e8c-98a9-5a7224a329c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:43.426896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1badb04-6de1-4e8c-98a9-5a7224a329c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:43.427306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1badb04-6de1-4e8c-98a9-5a7224a329c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:43.436367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1badb04-6de1-4e8c-98a9-5a7224a329c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:43.438302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1badb04-6de1-4e8c-98a9-5a7224a329c5 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:43.448651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1181/2387] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:43.931384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23486a9a-f74f-4dfb-a3e2-6a70e08283fd None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:43.932262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23486a9a-f74f-4dfb-a3e2-6a70e08283fd None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:43.932480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23486a9a-f74f-4dfb-a3e2-6a70e08283fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:43.950717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-23486a9a-f74f-4dfb-a3e2-6a70e08283fd None None] MFA Rules not processed for user `b434038833084579adf853df718315b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:43.952079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-23486a9a-f74f-4dfb-a3e2-6a70e08283fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:44.006915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1207/2388] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:47.425445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1badb04-6de1-4e8c-98a9-5a7224a329c5 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:47.489197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1badb04-6de1-4e8c-98a9-5a7224a329c5 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:47.493849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:47.494753 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:47.495032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:47.495301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] PATH_INFO: `/v3/users/76d125fe0e0046cbaaa29f484d1c4bb8` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:47.496473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d125fe0e0046cbaaa29f484d1c4bb8)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:47.498435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:47.550946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d125fe0e0046cbaaa29f484d1c4bb8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.558328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d125fe0e0046cbaaa29f484d1c4bb8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.566611 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d125fe0e0046cbaaa29f484d1c4bb8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.567244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d125fe0e0046cbaaa29f484d1c4bb8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.567910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d125fe0e0046cbaaa29f484d1c4bb8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.586627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1182/2389] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:47 2022] DELETE /identity/v3/users/76d125fe0e0046cbaaa29f484d1c4bb8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:47.599059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d5d22-707d-4a72-9af9-ab7824c37cf2 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:47.599059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d5d22-707d-4a72-9af9-ab7824c37cf2 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:47.599059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d5d22-707d-4a72-9af9-ab7824c37cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:47.610017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1d7d5d22-707d-4a72-9af9-ab7824c37cf2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:47.611252 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1d7d5d22-707d-4a72-9af9-ab7824c37cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:47.670327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:47.672346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:47.691124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1208/2390] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:28:47.704174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d5d22-707d-4a72-9af9-ab7824c37cf2 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:47.705617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1d7d5d22-707d-4a72-9af9-ab7824c37cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:47.748976 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0754db-371a-4af6-8586-d7d91e92ce69 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:47.754076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:47.755176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:47.755581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:47.755862 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] PATH_INFO: `/v3/users/3dd900304ee74e97b18ec150ac97a43a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:47.757108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd900304ee74e97b18ec150ac97a43a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:47.759062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:47.771090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d5d22-707d-4a72-9af9-ab7824c37cf2 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:47.775103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ad92-d8c1-451e-b4b1-4ee746fa4777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:47.775863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ad92-d8c1-451e-b4b1-4ee746fa4777 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:47.776245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ad92-d8c1-451e-b4b1-4ee746fa4777 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:47.776618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ad92-d8c1-451e-b4b1-4ee746fa4777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:47.787202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4ad92-d8c1-451e-b4b1-4ee746fa4777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:47.788809 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4ad92-d8c1-451e-b4b1-4ee746fa4777 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:47.800718 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1209/2391] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:28:47.820237 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd900304ee74e97b18ec150ac97a43a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.830700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd900304ee74e97b18ec150ac97a43a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.841236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd900304ee74e97b18ec150ac97a43a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.842954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd900304ee74e97b18ec150ac97a43a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.844015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd900304ee74e97b18ec150ac97a43a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:47.868289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1183/2392] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:47 2022] DELETE /identity/v3/users/3dd900304ee74e97b18ec150ac97a43a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:47.871642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e23a1-4505-4b48-8f4d-e99b6d25c889 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:47.872284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e23a1-4505-4b48-8f4d-e99b6d25c889 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:47.872760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e23a1-4505-4b48-8f4d-e99b6d25c889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:47.897303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d75e23a1-4505-4b48-8f4d-e99b6d25c889 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:47.899888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d75e23a1-4505-4b48-8f4d-e99b6d25c889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:47.990682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1210/2393] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:48.006556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:48.008001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:48.070442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a2ddf-9d16-47cf-8a42-9b34aed43ab6 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:48.075048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5209ec-b93f-4780-9246-1243f8788b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:48.075818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5209ec-b93f-4780-9246-1243f8788b9c service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:48.076168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5209ec-b93f-4780-9246-1243f8788b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:48.076449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5209ec-b93f-4780-9246-1243f8788b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:48.087246 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5209ec-b93f-4780-9246-1243f8788b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:48.088850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5209ec-b93f-4780-9246-1243f8788b9c service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:48.101852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1184/2394] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:48.162955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e23a1-4505-4b48-8f4d-e99b6d25c889 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:48.165119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d75e23a1-4505-4b48-8f4d-e99b6d25c889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:48.190635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e23a1-4505-4b48-8f4d-e99b6d25c889 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:48.198729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:48.202415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:48.202707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:48.203578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] PATH_INFO: `/v3/projects/818b3fdb2b0045769c9ceebf24f0987f` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:48.205601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818b3fdb2b0045769c9ceebf24f0987f)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:48.209659 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:48.271848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818b3fdb2b0045769c9ceebf24f0987f', 'request_id': 'req-01b0248a-c505-4c97-8c2e-531edc6384f5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.280261 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818b3fdb2b0045769c9ceebf24f0987f', 'request_id': 'req-01b0248a-c505-4c97-8c2e-531edc6384f5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.288261 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818b3fdb2b0045769c9ceebf24f0987f', 'request_id': 'req-01b0248a-c505-4c97-8c2e-531edc6384f5'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.300464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] The token cache is being invalidate because project 818b3fdb2b0045769c9ceebf24f0987f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:48.300756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.301424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.303344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1211/2395] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:48 2022] DELETE /identity/v3/projects/818b3fdb2b0045769c9ceebf24f0987f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:48.307020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5209ec-b93f-4780-9246-1243f8788b9c service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:48.336853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5209ec-b93f-4780-9246-1243f8788b9c service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:48.435527 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:48.436877 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:48.437151 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:48.437487 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] PATH_INFO: `/v3/users/057908f9874149edb504cded02dd4c52` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:48.439096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] RBAC: Authorizing `identity:delete_user(user_id=057908f9874149edb504cded02dd4c52)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:48.441681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:48.502087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '057908f9874149edb504cded02dd4c52'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.509762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '057908f9874149edb504cded02dd4c52'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.517986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '057908f9874149edb504cded02dd4c52'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.519124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '057908f9874149edb504cded02dd4c52'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.520084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '057908f9874149edb504cded02dd4c52'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.542057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1185/2396] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:48 2022] DELETE /identity/v3/users/057908f9874149edb504cded02dd4c52 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:48.569107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:48.570706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:48.583385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b0248a-c505-4c97-8c2e-531edc6384f5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:48.663167 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:48.664085 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:48.664374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:48.664650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] PATH_INFO: `/v3/projects/0a62be94e0264615ba080586866da228` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:48.665954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a62be94e0264615ba080586866da228)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:48.667926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:48.718616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a62be94e0264615ba080586866da228', 'request_id': 'req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.726651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a62be94e0264615ba080586866da228', 'request_id': 'req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.734196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a62be94e0264615ba080586866da228', 'request_id': 'req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.744166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] The token cache is being invalidate because project 0a62be94e0264615ba080586866da228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:48.744450 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.745101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:48.746743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1212/2397] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:48 2022] DELETE /identity/v3/projects/0a62be94e0264615ba080586866da228 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:28:48.871489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:48.872941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:48.900941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d4c73-ef5b-4d6d-8f1f-3c1ea7cd731d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:48.974655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:48.975516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:48.975797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:48.976068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] PATH_INFO: `/v3/projects/1587d6bb45754c7bb763c48daa9c6421` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:48.977229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1587d6bb45754c7bb763c48daa9c6421)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:48.979180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:49.023078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1587d6bb45754c7bb763c48daa9c6421', 'request_id': 'req-442c3770-362c-480f-bb68-4ad027d00e88'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.029079 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1587d6bb45754c7bb763c48daa9c6421', 'request_id': 'req-442c3770-362c-480f-bb68-4ad027d00e88'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.034849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1587d6bb45754c7bb763c48daa9c6421', 'request_id': 'req-442c3770-362c-480f-bb68-4ad027d00e88'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.046722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] The token cache is being invalidate because project 1587d6bb45754c7bb763c48daa9c6421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:49.047003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.047636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.049168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1186/2398] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:48 2022] DELETE /identity/v3/projects/1587d6bb45754c7bb763c48daa9c6421 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:49.053026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:49.054480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:49.066357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8ef15-1b9d-4af7-a17b-e9cc16a3b2b9 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:49.119610 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:49.120435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:49.120714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:49.120993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] PATH_INFO: `/v3/users/9cc96e6475674c79bf4bc7945beb3645` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:49.122128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cc96e6475674c79bf4bc7945beb3645)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:49.124079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:49.169764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cc96e6475674c79bf4bc7945beb3645'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.176295 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cc96e6475674c79bf4bc7945beb3645'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.183126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cc96e6475674c79bf4bc7945beb3645'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.183739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cc96e6475674c79bf4bc7945beb3645'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.184342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ff3fbb6b-424d-4e54-aee7-f537a4e81eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cc96e6475674c79bf4bc7945beb3645'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.200519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1213/2399] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:28:49 2022] DELETE /identity/v3/users/9cc96e6475674c79bf4bc7945beb3645 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:49.641670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:49.644023 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:49.656561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c3770-362c-480f-bb68-4ad027d00e88 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:49.717624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:49.718549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:49.718830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:49.719105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] PATH_INFO: `/v3/projects/0eb92e6bd32f4f87847443ea07deba15` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:49.720272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb92e6bd32f4f87847443ea07deba15)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:49.722373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:49.768050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb92e6bd32f4f87847443ea07deba15', 'request_id': 'req-20abd471-676c-4865-8ef5-f80d4c8aa770'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.774634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb92e6bd32f4f87847443ea07deba15', 'request_id': 'req-20abd471-676c-4865-8ef5-f80d4c8aa770'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.780815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb92e6bd32f4f87847443ea07deba15', 'request_id': 'req-20abd471-676c-4865-8ef5-f80d4c8aa770'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.804508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] The token cache is being invalidate because project 0eb92e6bd32f4f87847443ea07deba15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:28:49.804798 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.805439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-20abd471-676c-4865-8ef5-f80d4c8aa770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:28:49.807194 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1187/2400] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:28:49 2022] DELETE /identity/v3/projects/0eb92e6bd32f4f87847443ea07deba15 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:49.812748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972787-951c-41c0-98ee-b98fb9249c5f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:49.813222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972787-951c-41c0-98ee-b98fb9249c5f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:49.813332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29972787-951c-41c0-98ee-b98fb9249c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:49.831048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-29972787-951c-41c0-98ee-b98fb9249c5f None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:49.832241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-29972787-951c-41c0-98ee-b98fb9249c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:49.891431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1214/2401] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:49.900631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c8442-50f2-4503-b3a6-f0bf211356f1 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:49.900927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c8442-50f2-4503-b3a6-f0bf211356f1 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:49.901213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c8442-50f2-4503-b3a6-f0bf211356f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:49.924091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-9f7c8442-50f2-4503-b3a6-f0bf211356f1 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:49.925334 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9f7c8442-50f2-4503-b3a6-f0bf211356f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:49.938149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1188/2402] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:49.942616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29972787-951c-41c0-98ee-b98fb9249c5f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:49.954899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29972787-951c-41c0-98ee-b98fb9249c5f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:49.968679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383b98c-4315-4c94-b500-cea74178e155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:49.970580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383b98c-4315-4c94-b500-cea74178e155 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:49.970964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383b98c-4315-4c94-b500-cea74178e155 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:49.971361 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383b98c-4315-4c94-b500-cea74178e155 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:49.972933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383b98c-4315-4c94-b500-cea74178e155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:28:49.973536 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383b98c-4315-4c94-b500-cea74178e155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:49.975998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383b98c-4315-4c94-b500-cea74178e155 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:49.992732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1215/2403] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:28:49.996860 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c8442-50f2-4503-b3a6-f0bf211356f1 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:50.007886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c8442-50f2-4503-b3a6-f0bf211356f1 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:50.013437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10228df7-7e10-4a68-aff5-0604bd3fa98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:50.014120 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228df7-7e10-4a68-aff5-0604bd3fa98e admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:50.014998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228df7-7e10-4a68-aff5-0604bd3fa98e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:50.015275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10228df7-7e10-4a68-aff5-0604bd3fa98e admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:50.015993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10228df7-7e10-4a68-aff5-0604bd3fa98e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:50.017921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10228df7-7e10-4a68-aff5-0604bd3fa98e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:50.047332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1189/2404] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:49 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:50.051975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383b98c-4315-4c94-b500-cea74178e155 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:50.064197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383b98c-4315-4c94-b500-cea74178e155 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:50.136345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a336b93-f3a3-4d4c-8fb6-e5ea5ea5d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:50.137121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336b93-f3a3-4d4c-8fb6-e5ea5ea5d8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:50.137486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336b93-f3a3-4d4c-8fb6-e5ea5ea5d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:50.137833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a336b93-f3a3-4d4c-8fb6-e5ea5ea5d8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:50.138724 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a336b93-f3a3-4d4c-8fb6-e5ea5ea5d8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:50.140871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a336b93-f3a3-4d4c-8fb6-e5ea5ea5d8f9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:50.166406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1216/2405] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:50 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:50.170449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10228df7-7e10-4a68-aff5-0604bd3fa98e admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:50.186891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10228df7-7e10-4a68-aff5-0604bd3fa98e admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:50.192158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2465022-9f67-4646-80f6-85380afaf2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:50.192759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465022-9f67-4646-80f6-85380afaf2cc admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:50.193206 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465022-9f67-4646-80f6-85380afaf2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:50.193355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465022-9f67-4646-80f6-85380afaf2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:50.194073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2465022-9f67-4646-80f6-85380afaf2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:50.195824 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2465022-9f67-4646-80f6-85380afaf2cc admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:50.225678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1190/2406] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:50.226366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a336b93-f3a3-4d4c-8fb6-e5ea5ea5d8f9 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:50.241308 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a336b93-f3a3-4d4c-8fb6-e5ea5ea5d8f9 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:50.251983 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ef694-066d-4146-b794-6bb049ed6e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:50.253109 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ef694-066d-4146-b794-6bb049ed6e56 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:50.254861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ef694-066d-4146-b794-6bb049ed6e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:50.255245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ef694-066d-4146-b794-6bb049ed6e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:50.256122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ef694-066d-4146-b794-6bb049ed6e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:50.257770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ef694-066d-4146-b794-6bb049ed6e56 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:50.273789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2465022-9f67-4646-80f6-85380afaf2cc admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:50.284006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1217/2407] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:50.285473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2465022-9f67-4646-80f6-85380afaf2cc admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:50.290421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96152a94-9d87-4c8a-8cdd-aced9288c86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:50.291331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96152a94-9d87-4c8a-8cdd-aced9288c86b admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:50.291651 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96152a94-9d87-4c8a-8cdd-aced9288c86b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:50.291969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96152a94-9d87-4c8a-8cdd-aced9288c86b admin admin] PATH_INFO: `/v3/projects/c03f71e524b24b8abf5e7c81842f4e75/users/8ee7971dfb4e4c22aac3d97db9ee04d0/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:50.315865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96152a94-9d87-4c8a-8cdd-aced9288c86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03f71e524b24b8abf5e7c81842f4e75, user_id=8ee7971dfb4e4c22aac3d97db9ee04d0, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:50.318987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96152a94-9d87-4c8a-8cdd-aced9288c86b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:50.334300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1191/2408] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:50 2022] PUT /identity/v3/projects/c03f71e524b24b8abf5e7c81842f4e75/users/8ee7971dfb4e4c22aac3d97db9ee04d0/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:50.339635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd03c-2ff1-4267-abf8-d0168b9531dd None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:50.339942 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd03c-2ff1-4267-abf8-d0168b9531dd None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:50.340217 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fd03c-2ff1-4267-abf8-d0168b9531dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:50.360950 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f15fd03c-2ff1-4267-abf8-d0168b9531dd None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:50.362276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f15fd03c-2ff1-4267-abf8-d0168b9531dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:50.428310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1218/2409] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:50.438203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96152a94-9d87-4c8a-8cdd-aced9288c86b admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:50.440037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-96152a94-9d87-4c8a-8cdd-aced9288c86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:50.498438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96152a94-9d87-4c8a-8cdd-aced9288c86b admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:50.502073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8595f71-052e-44ac-8753-f3dc93503570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:50.502760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8595f71-052e-44ac-8753-f3dc93503570 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:50.503047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8595f71-052e-44ac-8753-f3dc93503570 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:50.503323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8595f71-052e-44ac-8753-f3dc93503570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:50.512460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8595f71-052e-44ac-8753-f3dc93503570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:50.513941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8595f71-052e-44ac-8753-f3dc93503570 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:50.524230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1192/2410] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:51.601159 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fd03c-2ff1-4267-abf8-d0168b9531dd None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:51.604035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f15fd03c-2ff1-4267-abf8-d0168b9531dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:51.729283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fd03c-2ff1-4267-abf8-d0168b9531dd None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:51.739396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeacdf-f5f1-4f00-8612-7e5ce1cd6c20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92588782f32a472193340aba2bff8d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:51.740982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeacdf-f5f1-4f00-8612-7e5ce1cd6c20 service placement] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:51.741426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeacdf-f5f1-4f00-8612-7e5ce1cd6c20 service placement] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:51.741892 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeacdf-f5f1-4f00-8612-7e5ce1cd6c20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:51.745526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3ddeacdf-f5f1-4f00-8612-7e5ce1cd6c20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:51.761688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeacdf-f5f1-4f00-8612-7e5ce1cd6c20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:51.763510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeacdf-f5f1-4f00-8612-7e5ce1cd6c20 service placement] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:51.776760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1219/2411] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:28:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:28:55.094354 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e9a57-a657-4a38-b118-11977bb50bdc None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:55.094808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e9a57-a657-4a38-b118-11977bb50bdc None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:55.094900 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e9a57-a657-4a38-b118-11977bb50bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:55.135466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-921e9a57-a657-4a38-b118-11977bb50bdc None None] MFA Rules not processed for user `8ee7971dfb4e4c22aac3d97db9ee04d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:28:55.136891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-921e9a57-a657-4a38-b118-11977bb50bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:28:55.214824 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1193/2412] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:28:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:28:55.219408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeacdf-f5f1-4f00-8612-7e5ce1cd6c20 service placement] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:55.235118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeacdf-f5f1-4f00-8612-7e5ce1cd6c20 service placement] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:55.240129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f733-3e60-4a7e-a179-338553d5682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:55.240789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f733-3e60-4a7e-a179-338553d5682a admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:55.241865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f733-3e60-4a7e-a179-338553d5682a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:55.242327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f733-3e60-4a7e-a179-338553d5682a admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:55.243159 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15f733-3e60-4a7e-a179-338553d5682a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:55.245828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15f733-3e60-4a7e-a179-338553d5682a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:55.287179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1220/2413] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:28:55 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:28:55.290891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e9a57-a657-4a38-b118-11977bb50bdc None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:55.302330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e9a57-a657-4a38-b118-11977bb50bdc None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:55.364403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd7bd5-556a-4969-b68f-5891ce51fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:55.365088 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd7bd5-556a-4969-b68f-5891ce51fdbc admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:55.365370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd7bd5-556a-4969-b68f-5891ce51fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:55.365648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd7bd5-556a-4969-b68f-5891ce51fdbc admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:55.366405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd7bd5-556a-4969-b68f-5891ce51fdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:55.368381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd7bd5-556a-4969-b68f-5891ce51fdbc admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:55.392537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1194/2414] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:28:55 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:28:55.397273 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f733-3e60-4a7e-a179-338553d5682a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:55.409838 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f733-3e60-4a7e-a179-338553d5682a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:55.421911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a54ee-96fa-452f-a8a8-c400a4e62e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:55.422791 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a54ee-96fa-452f-a8a8-c400a4e62e96 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:55.423082 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a54ee-96fa-452f-a8a8-c400a4e62e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:55.423362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a54ee-96fa-452f-a8a8-c400a4e62e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:55.424099 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a54ee-96fa-452f-a8a8-c400a4e62e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:55.425700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a54ee-96fa-452f-a8a8-c400a4e62e96 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:55.437500 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1221/2415] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:55.441567 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd7bd5-556a-4969-b68f-5891ce51fdbc admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:55.452168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd7bd5-556a-4969-b68f-5891ce51fdbc admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:55.457080 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405113-25ea-4163-a599-c93782393856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:55.458812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405113-25ea-4163-a599-c93782393856 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:55.459095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405113-25ea-4163-a599-c93782393856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:55.459371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405113-25ea-4163-a599-c93782393856 admin admin] PATH_INFO: `/v3/projects/745d5f15b5cd44edad3d04af93236db9/users/559da777fad94426a9820ed6aa6f598c/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:55.477711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b405113-25ea-4163-a599-c93782393856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745d5f15b5cd44edad3d04af93236db9, user_id=559da777fad94426a9820ed6aa6f598c, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:55.480507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b405113-25ea-4163-a599-c93782393856 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:55.497025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1195/2416] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:55 2022] PUT /identity/v3/projects/745d5f15b5cd44edad3d04af93236db9/users/559da777fad94426a9820ed6aa6f598c/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:28:55.505124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a54ee-96fa-452f-a8a8-c400a4e62e96 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:55.516605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a54ee-96fa-452f-a8a8-c400a4e62e96 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:55.599134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e3ae7-3b3e-426f-872d-6bf69f717898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:55.599134 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3ae7-3b3e-426f-872d-6bf69f717898 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:55.599475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3ae7-3b3e-426f-872d-6bf69f717898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:55.599591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e3ae7-3b3e-426f-872d-6bf69f717898 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:55.600347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3ae7-3b3e-426f-872d-6bf69f717898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:55.601969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e3ae7-3b3e-426f-872d-6bf69f717898 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:55.614121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1222/2417] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:28:55.618151 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405113-25ea-4163-a599-c93782393856 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:28:55.629931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405113-25ea-4163-a599-c93782393856 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:28:55.634915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc2105-dba7-4d3f-bbed-e1af85db15b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:28:55.635806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc2105-dba7-4d3f-bbed-e1af85db15b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:28:55.636087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc2105-dba7-4d3f-bbed-e1af85db15b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:28:55.636600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc2105-dba7-4d3f-bbed-e1af85db15b2 admin admin] PATH_INFO: `/v3/projects/745d5f15b5cd44edad3d04af93236db9/users/559da777fad94426a9820ed6aa6f598c/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:28:55.639105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc2105-dba7-4d3f-bbed-e1af85db15b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=745d5f15b5cd44edad3d04af93236db9, user_id=559da777fad94426a9820ed6aa6f598c, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:28:55.641369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc2105-dba7-4d3f-bbed-e1af85db15b2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:28:55.653044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1196/2418] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:28:55 2022] PUT /identity/v3/projects/745d5f15b5cd44edad3d04af93236db9/users/559da777fad94426a9820ed6aa6f598c/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:29:00.702195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01bdf1-44bf-416f-8d70-182a4efdb6f7 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:00.702768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01bdf1-44bf-416f-8d70-182a4efdb6f7 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:00.703299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01bdf1-44bf-416f-8d70-182a4efdb6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:00.736517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-6a01bdf1-44bf-416f-8d70-182a4efdb6f7 None None] MFA Rules not processed for user `559da777fad94426a9820ed6aa6f598c`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:00.737807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6a01bdf1-44bf-416f-8d70-182a4efdb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:00.806606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1223/2419] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:29:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:29:00.817469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc2105-dba7-4d3f-bbed-e1af85db15b2 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:00.819200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-85dc2105-dba7-4d3f-bbed-e1af85db15b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:00.921047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc2105-dba7-4d3f-bbed-e1af85db15b2 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:00.926606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace635e-a0b7-45da-8223-a74e8a74aab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:00.927256 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace635e-a0b7-45da-8223-a74e8a74aab8 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:00.927536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace635e-a0b7-45da-8223-a74e8a74aab8 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:00.927809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace635e-a0b7-45da-8223-a74e8a74aab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:00.984398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace635e-a0b7-45da-8223-a74e8a74aab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:00.986032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace635e-a0b7-45da-8223-a74e8a74aab8 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:00.995666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1197/2420] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:29:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:29:02.252370 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0748a-6ef0-4707-8e3c-5a59b03d5fcb None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:02.252913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0748a-6ef0-4707-8e3c-5a59b03d5fcb None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:02.252913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0748a-6ef0-4707-8e3c-5a59b03d5fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:02.271358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f9d0748a-6ef0-4707-8e3c-5a59b03d5fcb None None] MFA Rules not processed for user `8ee7971dfb4e4c22aac3d97db9ee04d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:02.272557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f9d0748a-6ef0-4707-8e3c-5a59b03d5fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:02.279768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1224/2421] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:29:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:29:20.618005 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3f701-50ab-4f63-9cb5-c00021d96682 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:20.618533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3f701-50ab-4f63-9cb5-c00021d96682 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:20.618632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3f701-50ab-4f63-9cb5-c00021d96682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:20.674191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-7fd3f701-50ab-4f63-9cb5-c00021d96682 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:20.675494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7fd3f701-50ab-4f63-9cb5-c00021d96682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:20.737967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1198/2422] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:29:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:29:20.778590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0748a-6ef0-4707-8e3c-5a59b03d5fcb None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:20.780585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f9d0748a-6ef0-4707-8e3c-5a59b03d5fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:20.868953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0748a-6ef0-4707-8e3c-5a59b03d5fcb None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:20.879481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fad43-0b5c-4f9d-a9f6-e3df1e531fd9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:20.880216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fad43-0b5c-4f9d-a9f6-e3df1e531fd9 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:20.880564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fad43-0b5c-4f9d-a9f6-e3df1e531fd9 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:20.880918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fad43-0b5c-4f9d-a9f6-e3df1e531fd9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:20.890175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fad43-0b5c-4f9d-a9f6-e3df1e531fd9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:20.891866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fad43-0b5c-4f9d-a9f6-e3df1e531fd9 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:20.900444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1225/2423] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:29:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:29:43.385283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b215b-cacd-430d-b836-e89ed14e6cdc None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:43.385927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b215b-cacd-430d-b836-e89ed14e6cdc None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:43.385927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b215b-cacd-430d-b836-e89ed14e6cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:43.401653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a3980-483c-4c84-ab5e-1826c1de5740 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:43.402240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a3980-483c-4c84-ab5e-1826c1de5740 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:43.402240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a3980-483c-4c84-ab5e-1826c1de5740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:43.410551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-5b9b215b-cacd-430d-b836-e89ed14e6cdc None None] MFA Rules not processed for user `d01c35b046284938a73d4404234c1f24`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:43.412098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5b9b215b-cacd-430d-b836-e89ed14e6cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:43.422066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2b9a3980-483c-4c84-ab5e-1826c1de5740 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:43.423565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2b9a3980-483c-4c84-ab5e-1826c1de5740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:43.434171 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1226/2424] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 00:29:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:29:43.447020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a3980-483c-4c84-ab5e-1826c1de5740 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:43.461492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a3980-483c-4c84-ab5e-1826c1de5740 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:43.468953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c3b6-8047-44a2-aa5e-1e10fd7414e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:43.470023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c3b6-8047-44a2-aa5e-1e10fd7414e6 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:43.470782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c3b6-8047-44a2-aa5e-1e10fd7414e6 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:43.471398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c3b6-8047-44a2-aa5e-1e10fd7414e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:43.474661 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1199/2425] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:29:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:29:43.480860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173c3b6-8047-44a2-aa5e-1e10fd7414e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:43.482806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173c3b6-8047-44a2-aa5e-1e10fd7414e6 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:43.493504 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1227/2426] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:29:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 00:29:45.601795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b215b-cacd-430d-b836-e89ed14e6cdc None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:45.603332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5b9b215b-cacd-430d-b836-e89ed14e6cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:45.666235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b215b-cacd-430d-b836-e89ed14e6cdc None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:45.670632 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:45.671493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:45.671777 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:45.672047 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] PATH_INFO: `/v3/users/f1db4aee3a4d43ccb111eb7ede0510d9` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:45.673222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1db4aee3a4d43ccb111eb7ede0510d9)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:45.675266 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:45.720595 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1db4aee3a4d43ccb111eb7ede0510d9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:45.727482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1db4aee3a4d43ccb111eb7ede0510d9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:45.734582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1db4aee3a4d43ccb111eb7ede0510d9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:45.735327 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1db4aee3a4d43ccb111eb7ede0510d9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:45.735989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a723f6-9413-4475-b855-ce320f569872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1db4aee3a4d43ccb111eb7ede0510d9'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:45.754119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1200/2427] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:29:45 2022] DELETE /identity/v3/users/f1db4aee3a4d43ccb111eb7ede0510d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:29:45.922972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c3b6-8047-44a2-aa5e-1e10fd7414e6 service swift] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:45.935178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c3b6-8047-44a2-aa5e-1e10fd7414e6 service swift] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:45.997600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:45.998512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:45.998791 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:45.999497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] PATH_INFO: `/v3/projects/c67b239e9580469aaa5714c21a4c590d` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.000656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67b239e9580469aaa5714c21a4c590d)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:46.003090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:46.057526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67b239e9580469aaa5714c21a4c590d', 'request_id': 'req-52652d6f-8b25-41e7-812f-571c2782debb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:46.065725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67b239e9580469aaa5714c21a4c590d', 'request_id': 'req-52652d6f-8b25-41e7-812f-571c2782debb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:46.072608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67b239e9580469aaa5714c21a4c590d', 'request_id': 'req-52652d6f-8b25-41e7-812f-571c2782debb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:46.082445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] The token cache is being invalidate because project c67b239e9580469aaa5714c21a4c590d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:29:46.082793 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:46.083430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-52652d6f-8b25-41e7-812f-571c2782debb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:29:46.084964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1228/2428] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:29:45 2022] DELETE /identity/v3/projects/c67b239e9580469aaa5714c21a4c590d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:29:46.089995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bac23e-a7f2-403c-899a-2e3569958276 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.090305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bac23e-a7f2-403c-899a-2e3569958276 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.090616 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bac23e-a7f2-403c-899a-2e3569958276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.108809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-22bac23e-a7f2-403c-899a-2e3569958276 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:46.110007 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-22bac23e-a7f2-403c-899a-2e3569958276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:46.166445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1201/2429] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:29:46.174611 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764152c-b4af-4a3e-a5ac-124924d60708 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.174830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764152c-b4af-4a3e-a5ac-124924d60708 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.175115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764152c-b4af-4a3e-a5ac-124924d60708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.193767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f764152c-b4af-4a3e-a5ac-124924d60708 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:46.195003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f764152c-b4af-4a3e-a5ac-124924d60708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:46.203240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1229/2430] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:29:46.207150 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bac23e-a7f2-403c-899a-2e3569958276 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:46.216493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bac23e-a7f2-403c-899a-2e3569958276 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:46.220977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9503b-b52d-4be1-8d42-9e7ac9eebedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:46.221616 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9503b-b52d-4be1-8d42-9e7ac9eebedf admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.221894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9503b-b52d-4be1-8d42-9e7ac9eebedf admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.222173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9503b-b52d-4be1-8d42-9e7ac9eebedf admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.222919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9503b-b52d-4be1-8d42-9e7ac9eebedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:29:46.223218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9503b-b52d-4be1-8d42-9e7ac9eebedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:46.224798 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9503b-b52d-4be1-8d42-9e7ac9eebedf admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:46.236935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1202/2431] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:29:46.241142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764152c-b4af-4a3e-a5ac-124924d60708 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:46.250736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764152c-b4af-4a3e-a5ac-124924d60708 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:46.255310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41103e6-0289-4c79-a94d-a33e26d1afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:46.255954 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41103e6-0289-4c79-a94d-a33e26d1afb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.256243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41103e6-0289-4c79-a94d-a33e26d1afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.256517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41103e6-0289-4c79-a94d-a33e26d1afb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.257314 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41103e6-0289-4c79-a94d-a33e26d1afb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:46.259278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41103e6-0289-4c79-a94d-a33e26d1afb8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:46.283978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1230/2432] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:29:46 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:29:46.288249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9503b-b52d-4be1-8d42-9e7ac9eebedf admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:46.298630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9503b-b52d-4be1-8d42-9e7ac9eebedf admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:46.360843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b3be8-4847-4b1d-ad94-19eb8abf95d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:46.361520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b3be8-4847-4b1d-ad94-19eb8abf95d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.361837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b3be8-4847-4b1d-ad94-19eb8abf95d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.362114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b3be8-4847-4b1d-ad94-19eb8abf95d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.362837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b3be8-4847-4b1d-ad94-19eb8abf95d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:46.364765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b3be8-4847-4b1d-ad94-19eb8abf95d2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:46.384052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1203/2433] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:29:46 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:29:46.388240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41103e6-0289-4c79-a94d-a33e26d1afb8 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:46.399260 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41103e6-0289-4c79-a94d-a33e26d1afb8 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:46.404996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656155ea-6989-4485-9da0-434579f900a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:46.405681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656155ea-6989-4485-9da0-434579f900a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.405962 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656155ea-6989-4485-9da0-434579f900a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.406236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656155ea-6989-4485-9da0-434579f900a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.406981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656155ea-6989-4485-9da0-434579f900a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:46.408579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656155ea-6989-4485-9da0-434579f900a0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:46.420541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1231/2434] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:29:46.424816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b3be8-4847-4b1d-ad94-19eb8abf95d2 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:46.435741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b3be8-4847-4b1d-ad94-19eb8abf95d2 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:46.440988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85f7b2-b7c9-4e22-b869-b077bdd60928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:46.441891 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85f7b2-b7c9-4e22-b869-b077bdd60928 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.442235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85f7b2-b7c9-4e22-b869-b077bdd60928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.442601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85f7b2-b7c9-4e22-b869-b077bdd60928 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.443399 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85f7b2-b7c9-4e22-b869-b077bdd60928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:46.446555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85f7b2-b7c9-4e22-b869-b077bdd60928 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:46.459427 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1204/2435] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:29:46.464103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656155ea-6989-4485-9da0-434579f900a0 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:46.476223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656155ea-6989-4485-9da0-434579f900a0 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:46.480868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7e7f8-1cca-44ce-ab89-ad9de3a674a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:46.482388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7e7f8-1cca-44ce-ab89-ad9de3a674a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.482668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7e7f8-1cca-44ce-ab89-ad9de3a674a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.482937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f7e7f8-1cca-44ce-ab89-ad9de3a674a6 admin admin] PATH_INFO: `/v3/projects/4ad54dac63374c8a9b4da55ee5dc7fd1/users/3b1d212dad5347a888832a779beadece/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.498416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7e7f8-1cca-44ce-ab89-ad9de3a674a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad54dac63374c8a9b4da55ee5dc7fd1, user_id=3b1d212dad5347a888832a779beadece, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:46.501042 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f7e7f8-1cca-44ce-ab89-ad9de3a674a6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:46.517961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1232/2436] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:29:46 2022] PUT /identity/v3/projects/4ad54dac63374c8a9b4da55ee5dc7fd1/users/3b1d212dad5347a888832a779beadece/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:29:46.523253 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb701e-12d9-4d9a-9e0e-e4d3c4e9e032 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.523547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb701e-12d9-4d9a-9e0e-e4d3c4e9e032 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.523826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb701e-12d9-4d9a-9e0e-e4d3c4e9e032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.549338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-adcb701e-12d9-4d9a-9e0e-e4d3c4e9e032 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:46.551044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-adcb701e-12d9-4d9a-9e0e-e4d3c4e9e032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:46.617852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1205/2437] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:29:46.627825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7e7f8-1cca-44ce-ab89-ad9de3a674a6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:46.629636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c1f7e7f8-1cca-44ce-ab89-ad9de3a674a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:46.688765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f7e7f8-1cca-44ce-ab89-ad9de3a674a6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:46.692354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606343fc-5cce-4ac7-baaa-b70bf07846a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:46.692986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606343fc-5cce-4ac7-baaa-b70bf07846a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:46.693332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606343fc-5cce-4ac7-baaa-b70bf07846a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:46.693525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606343fc-5cce-4ac7-baaa-b70bf07846a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:46.703066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606343fc-5cce-4ac7-baaa-b70bf07846a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:46.704479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606343fc-5cce-4ac7-baaa-b70bf07846a3 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:46.713496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1233/2438] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:29:52.850405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb5da-ee2c-4377-b464-a216118f9d18 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:52.850889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb5da-ee2c-4377-b464-a216118f9d18 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:52.851021 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb5da-ee2c-4377-b464-a216118f9d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:52.885980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fb0eb5da-ee2c-4377-b464-a216118f9d18 None None] MFA Rules not processed for user `3b1d212dad5347a888832a779beadece`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:52.887660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fb0eb5da-ee2c-4377-b464-a216118f9d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:52.951316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1206/2439] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:29:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:29:52.955751 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606343fc-5cce-4ac7-baaa-b70bf07846a3 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:52.965882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606343fc-5cce-4ac7-baaa-b70bf07846a3 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:52.970501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4cef9-d429-4ab5-ae5a-fd45c6629262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:52.971148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4cef9-d429-4ab5-ae5a-fd45c6629262 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:52.971429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4cef9-d429-4ab5-ae5a-fd45c6629262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:52.971705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4cef9-d429-4ab5-ae5a-fd45c6629262 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:52.972385 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4cef9-d429-4ab5-ae5a-fd45c6629262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:52.974363 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4cef9-d429-4ab5-ae5a-fd45c6629262 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:52.998416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1234/2440] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:29:52 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:29:53.002678 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eb5da-ee2c-4377-b464-a216118f9d18 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:53.013867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eb5da-ee2c-4377-b464-a216118f9d18 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:53.067446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e81c-6b64-41d5-b281-856dba3abb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:53.068118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e81c-6b64-41d5-b281-856dba3abb95 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:53.068405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e81c-6b64-41d5-b281-856dba3abb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:53.068682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928e81c-6b64-41d5-b281-856dba3abb95 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:53.069389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928e81c-6b64-41d5-b281-856dba3abb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:53.071507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928e81c-6b64-41d5-b281-856dba3abb95 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:53.092046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1207/2441] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:29:53 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:29:53.095599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4cef9-d429-4ab5-ae5a-fd45c6629262 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:53.107655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4cef9-d429-4ab5-ae5a-fd45c6629262 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:53.112501 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41930a3f-8f4d-4bb2-89e0-95204f9ae1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:53.113357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41930a3f-8f4d-4bb2-89e0-95204f9ae1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:53.113624 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41930a3f-8f4d-4bb2-89e0-95204f9ae1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:53.113902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41930a3f-8f4d-4bb2-89e0-95204f9ae1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:53.114660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41930a3f-8f4d-4bb2-89e0-95204f9ae1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:53.116248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41930a3f-8f4d-4bb2-89e0-95204f9ae1d2 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:53.127695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1235/2442] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:29:53.131770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e81c-6b64-41d5-b281-856dba3abb95 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:53.143692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928e81c-6b64-41d5-b281-856dba3abb95 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:53.148884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead1024-10c6-47f7-8f50-ba7d721ed16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:53.149830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead1024-10c6-47f7-8f50-ba7d721ed16d admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:53.150145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead1024-10c6-47f7-8f50-ba7d721ed16d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:53.150467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead1024-10c6-47f7-8f50-ba7d721ed16d admin admin] PATH_INFO: `/v3/projects/3de3a4084d864ba6845b0d8385e0b593/users/2ee3867006104ecaa42cbd7e2ad9aead/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:53.173791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead1024-10c6-47f7-8f50-ba7d721ed16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de3a4084d864ba6845b0d8385e0b593, user_id=2ee3867006104ecaa42cbd7e2ad9aead, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:53.176760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead1024-10c6-47f7-8f50-ba7d721ed16d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:53.191847 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1208/2443] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:29:53 2022] PUT /identity/v3/projects/3de3a4084d864ba6845b0d8385e0b593/users/2ee3867006104ecaa42cbd7e2ad9aead/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:29:53.195772 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41930a3f-8f4d-4bb2-89e0-95204f9ae1d2 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:53.206013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41930a3f-8f4d-4bb2-89e0-95204f9ae1d2 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:53.276232 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc2617-d94a-4928-b9a9-d61b1d640898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:53.277044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc2617-d94a-4928-b9a9-d61b1d640898 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:53.277410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc2617-d94a-4928-b9a9-d61b1d640898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:53.278265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc2617-d94a-4928-b9a9-d61b1d640898 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:53.279067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc2617-d94a-4928-b9a9-d61b1d640898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:53.280715 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc2617-d94a-4928-b9a9-d61b1d640898 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:53.293558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1236/2444] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:29:53.294864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead1024-10c6-47f7-8f50-ba7d721ed16d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:53.306155 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead1024-10c6-47f7-8f50-ba7d721ed16d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:53.312313 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4fb9f-e120-4f99-b47e-f2521bc78d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:53.313218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4fb9f-e120-4f99-b47e-f2521bc78d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:53.313497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4fb9f-e120-4f99-b47e-f2521bc78d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:53.313774 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4fb9f-e120-4f99-b47e-f2521bc78d24 admin admin] PATH_INFO: `/v3/projects/3de3a4084d864ba6845b0d8385e0b593/users/2ee3867006104ecaa42cbd7e2ad9aead/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:53.315789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4fb9f-e120-4f99-b47e-f2521bc78d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de3a4084d864ba6845b0d8385e0b593, user_id=2ee3867006104ecaa42cbd7e2ad9aead, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:53.318472 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4fb9f-e120-4f99-b47e-f2521bc78d24 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:53.330947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1209/2445] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:29:53 2022] PUT /identity/v3/projects/3de3a4084d864ba6845b0d8385e0b593/users/2ee3867006104ecaa42cbd7e2ad9aead/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:29:58.939195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe12f5d-d7b9-4628-8e75-6b550d3934e6 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:58.939678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe12f5d-d7b9-4628-8e75-6b550d3934e6 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:58.939784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe12f5d-d7b9-4628-8e75-6b550d3934e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:58.978482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-bbe12f5d-d7b9-4628-8e75-6b550d3934e6 None None] MFA Rules not processed for user `2ee3867006104ecaa42cbd7e2ad9aead`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:29:58.980029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bbe12f5d-d7b9-4628-8e75-6b550d3934e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:59.074989 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1237/2446] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:29:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:29:59.087283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4fb9f-e120-4f99-b47e-f2521bc78d24 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:29:59.089223 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c3c4fb9f-e120-4f99-b47e-f2521bc78d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:29:59.179161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4fb9f-e120-4f99-b47e-f2521bc78d24 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:29:59.191012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af530af-6cc0-452b-bba4-eb53cea8495a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:29:59.191795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af530af-6cc0-452b-bba4-eb53cea8495a service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:29:59.192148 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af530af-6cc0-452b-bba4-eb53cea8495a service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:29:59.192492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af530af-6cc0-452b-bba4-eb53cea8495a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:29:59.276589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af530af-6cc0-452b-bba4-eb53cea8495a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:29:59.282026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af530af-6cc0-452b-bba4-eb53cea8495a service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:29:59.292944 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1210/2447] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:29:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:30:03.952254 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe12f5d-d7b9-4628-8e75-6b550d3934e6 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:04.008561 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe12f5d-d7b9-4628-8e75-6b550d3934e6 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:04.012783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:04.013444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:04.013725 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:04.013996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:04.015866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:04.077375 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:04.078827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:04.088122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1238/2448] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:30:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:30:06.000864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebaad9-047c-4358-8512-6f35fc8865a9 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:06.001372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebaad9-047c-4358-8512-6f35fc8865a9 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:06.002204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebaad9-047c-4358-8512-6f35fc8865a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:06.049397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-aeebaad9-047c-4358-8512-6f35fc8865a9 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:30:06.051925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-aeebaad9-047c-4358-8512-6f35fc8865a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:06.172009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1211/2449] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:30:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:30:06.189427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:06.190946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:06.268099 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecc1e2-3466-4a6d-8026-a3c43c361c91 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:06.273596 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc98c3-968f-452c-b7ed-5fdede00ec6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:06.274498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc98c3-968f-452c-b7ed-5fdede00ec6f service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:06.274779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc98c3-968f-452c-b7ed-5fdede00ec6f service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:06.275054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc98c3-968f-452c-b7ed-5fdede00ec6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:06.284293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc98c3-968f-452c-b7ed-5fdede00ec6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:06.285874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc98c3-968f-452c-b7ed-5fdede00ec6f service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:06.294236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1239/2450] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:30:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:30:36.321269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b92d-c37d-4793-a4ee-338d663d699c None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:36.321884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b92d-c37d-4793-a4ee-338d663d699c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:36.321884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b92d-c37d-4793-a4ee-338d663d699c None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:36.323779 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1212/2451] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:30:36.330222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b9550-c69b-4172-82c0-41ababfdca8e None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:36.330772 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b9550-c69b-4172-82c0-41ababfdca8e None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:36.330871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b9550-c69b-4172-82c0-41ababfdca8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:36.367202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-081b9550-c69b-4172-82c0-41ababfdca8e None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:30:36.368446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-081b9550-c69b-4172-82c0-41ababfdca8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:36.377819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1240/2452] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:30:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:30:36.390269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b92d-c37d-4793-a4ee-338d663d699c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:36.391999 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a120b92d-c37d-4793-a4ee-338d663d699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:36.470359 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b92d-c37d-4793-a4ee-338d663d699c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:36.473819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17ca37-7f89-49ce-b139-130bd4736bf4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaf01f45e7a429e9361eb176a3f7c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:36.474488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17ca37-7f89-49ce-b139-130bd4736bf4 service glance] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:36.474772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17ca37-7f89-49ce-b139-130bd4736bf4 service glance] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:36.475049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17ca37-7f89-49ce-b139-130bd4736bf4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:36.484967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17ca37-7f89-49ce-b139-130bd4736bf4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:36.486413 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17ca37-7f89-49ce-b139-130bd4736bf4 service glance] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:36.496677 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1213/2453] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:30:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:30:36.563448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6a76f-10ae-4cda-a017-c99ca60a87e4 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:36.563739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6a76f-10ae-4cda-a017-c99ca60a87e4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:36.564019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6a76f-10ae-4cda-a017-c99ca60a87e4 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:36.565784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1241/2454] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:30:36.571330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5eff9-edc2-4af8-858a-b6370ab69978 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:36.571662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5eff9-edc2-4af8-858a-b6370ab69978 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:36.572004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5eff9-edc2-4af8-858a-b6370ab69978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:36.590642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-3cb5eff9-edc2-4af8-858a-b6370ab69978 None None] MFA Rules not processed for user `a99a9951d83446efbf819b72836afc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:30:36.591992 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3cb5eff9-edc2-4af8-858a-b6370ab69978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:36.598962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1214/2455] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:30:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:30:36.610754 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6a76f-10ae-4cda-a017-c99ca60a87e4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:36.622191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6a76f-10ae-4cda-a017-c99ca60a87e4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:36.625779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b82d4-3724-47cc-8a1b-53cc6176e669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:36.626387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b82d4-3724-47cc-8a1b-53cc6176e669 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:36.626673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b82d4-3724-47cc-8a1b-53cc6176e669 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:36.626948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b82d4-3724-47cc-8a1b-53cc6176e669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:36.633777 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b82d4-3724-47cc-8a1b-53cc6176e669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:36.635221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b82d4-3724-47cc-8a1b-53cc6176e669 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:36.642905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1242/2456] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:30:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:30:36.724245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f6a82-9c58-40c1-b654-6bf1aff04686 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:36.724537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f6a82-9c58-40c1-b654-6bf1aff04686 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:36.724836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f6a82-9c58-40c1-b654-6bf1aff04686 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:36.726225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1215/2457] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:30:36.732021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a53ff6-3a14-4201-8c73-9a49ce864d6d None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:36.732309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a53ff6-3a14-4201-8c73-9a49ce864d6d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:36.732585 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a53ff6-3a14-4201-8c73-9a49ce864d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:36.750022 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f5a53ff6-3a14-4201-8c73-9a49ce864d6d None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:30:36.751248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f5a53ff6-3a14-4201-8c73-9a49ce864d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:36.760215 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1243/2458] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:30:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:30:36.770320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f6a82-9c58-40c1-b654-6bf1aff04686 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:36.772264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fd0f6a82-9c58-40c1-b654-6bf1aff04686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:36.787620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f6a82-9c58-40c1-b654-6bf1aff04686 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:36.791549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b78255-bc2f-4cd3-9e9d-c69f32740912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:36.792372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b78255-bc2f-4cd3-9e9d-c69f32740912 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:36.792723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b78255-bc2f-4cd3-9e9d-c69f32740912 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:36.793095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b78255-bc2f-4cd3-9e9d-c69f32740912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:36.803741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b78255-bc2f-4cd3-9e9d-c69f32740912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:36.805199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b78255-bc2f-4cd3-9e9d-c69f32740912 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:36.816299 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1216/2459] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:30:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:30:41.642527 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a53ff6-3a14-4201-8c73-9a49ce864d6d None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:41.653441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a53ff6-3a14-4201-8c73-9a49ce864d6d None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:41.657056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1174a-83eb-4b78-8fec-e22948a6048e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:41.657928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1174a-83eb-4b78-8fec-e22948a6048e service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:41.658427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1174a-83eb-4b78-8fec-e22948a6048e service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:41.658852 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1174a-83eb-4b78-8fec-e22948a6048e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:41.661270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-daf1174a-83eb-4b78-8fec-e22948a6048e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:41.675582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1174a-83eb-4b78-8fec-e22948a6048e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:41.677523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1174a-83eb-4b78-8fec-e22948a6048e service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:41.685373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b78255-bc2f-4cd3-9e9d-c69f32740912 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:41.689609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1244/2460] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:30:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:30:41.707393 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b78255-bc2f-4cd3-9e9d-c69f32740912 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:41.711024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791e40-811d-42b6-874d-55c5c1a9e370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:41.711701 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791e40-811d-42b6-874d-55c5c1a9e370 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:41.711980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791e40-811d-42b6-874d-55c5c1a9e370 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:41.712250 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791e40-811d-42b6-874d-55c5c1a9e370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:41.714120 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-01791e40-811d-42b6-874d-55c5c1a9e370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:41.727238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01791e40-811d-42b6-874d-55c5c1a9e370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:41.728663 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01791e40-811d-42b6-874d-55c5c1a9e370 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:41.739971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1217/2461] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:30:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:30:42.271057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2a533-fec9-4516-8087-8f59e3874837 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:42.271967 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2a533-fec9-4516-8087-8f59e3874837 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:42.272260 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2a533-fec9-4516-8087-8f59e3874837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:42.292019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-6cc2a533-fec9-4516-8087-8f59e3874837 None None] MFA Rules not processed for user `3b1d212dad5347a888832a779beadece`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:30:42.293496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6cc2a533-fec9-4516-8087-8f59e3874837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:42.301690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1245/2462] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:30:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:30:42.411561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3c580-e619-454f-8442-fc6e6d5ff58a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:42.411896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3c580-e619-454f-8442-fc6e6d5ff58a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:42.412449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3c580-e619-454f-8442-fc6e6d5ff58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:42.432843 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-79e3c580-e619-454f-8442-fc6e6d5ff58a None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:30:42.434054 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-79e3c580-e619-454f-8442-fc6e6d5ff58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:42.441331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1218/2463] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:30:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:30:42.463307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2a533-fec9-4516-8087-8f59e3874837 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:42.475723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2a533-fec9-4516-8087-8f59e3874837 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:42.481064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ba5bc-5fb8-4654-82d8-a12808d187d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:42.481716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ba5bc-5fb8-4654-82d8-a12808d187d6 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:42.482004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ba5bc-5fb8-4654-82d8-a12808d187d6 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:42.482333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ba5bc-5fb8-4654-82d8-a12808d187d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:42.490913 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ba5bc-5fb8-4654-82d8-a12808d187d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:42.492600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ba5bc-5fb8-4654-82d8-a12808d187d6 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:42.500974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1246/2464] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:30:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:30:49.226937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3c580-e619-454f-8442-fc6e6d5ff58a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:49.241185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3c580-e619-454f-8442-fc6e6d5ff58a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:49.247723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311ec7-c404-4de3-9743-6d533ef9d342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:49.248453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311ec7-c404-4de3-9743-6d533ef9d342 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:49.248739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311ec7-c404-4de3-9743-6d533ef9d342 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:49.249035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47311ec7-c404-4de3-9743-6d533ef9d342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:49.251014 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-47311ec7-c404-4de3-9743-6d533ef9d342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:49.310570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47311ec7-c404-4de3-9743-6d533ef9d342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:49.312297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47311ec7-c404-4de3-9743-6d533ef9d342 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:49.321518 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1219/2465] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:30:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:30:52.335273 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ba5bc-5fb8-4654-82d8-a12808d187d6 service swift] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:52.336655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9b1ba5bc-5fb8-4654-82d8-a12808d187d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:52.352083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ba5bc-5fb8-4654-82d8-a12808d187d6 service swift] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:52.357394 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07357651-f3e0-4d5c-ba2b-fbab2b87b0de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:52.358050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07357651-f3e0-4d5c-ba2b-fbab2b87b0de service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:52.358361 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07357651-f3e0-4d5c-ba2b-fbab2b87b0de service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:52.358636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07357651-f3e0-4d5c-ba2b-fbab2b87b0de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:52.360362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-07357651-f3e0-4d5c-ba2b-fbab2b87b0de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:52.430720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07357651-f3e0-4d5c-ba2b-fbab2b87b0de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:52.433070 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07357651-f3e0-4d5c-ba2b-fbab2b87b0de service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:52.443404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1247/2466] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:30:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:30:57.128467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311ec7-c404-4de3-9743-6d533ef9d342 service nova] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:30:57.139452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47311ec7-c404-4de3-9743-6d533ef9d342 service nova] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:30:57.143328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49aa6-b0f4-4f74-831d-4a807a8ab7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:30:57.144179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49aa6-b0f4-4f74-831d-4a807a8ab7ef service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:30:57.144610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49aa6-b0f4-4f74-831d-4a807a8ab7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:30:57.145187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b49aa6-b0f4-4f74-831d-4a807a8ab7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:30:57.149889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-13b49aa6-b0f4-4f74-831d-4a807a8ab7ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:30:57.158086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b49aa6-b0f4-4f74-831d-4a807a8ab7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:30:57.159600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b49aa6-b0f4-4f74-831d-4a807a8ab7ef service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:30:57.169581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1220/2467] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:30:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:31:20.850605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3927629-6d1c-474e-a3ff-b36df520dfd5 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:31:20.851164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3927629-6d1c-474e-a3ff-b36df520dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:31:20.851164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3927629-6d1c-474e-a3ff-b36df520dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:31:20.867866 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-c3927629-6d1c-474e-a3ff-b36df520dfd5 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:31:20.869579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c3927629-6d1c-474e-a3ff-b36df520dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:31:20.876657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1248/2468] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 00:31:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:31:20.889373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49aa6-b0f4-4f74-831d-4a807a8ab7ef service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:31:20.901391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b49aa6-b0f4-4f74-831d-4a807a8ab7ef service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:31:20.906330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ab275-9e41-488b-afd3-8fe0304a56b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:31:20.906965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ab275-9e41-488b-afd3-8fe0304a56b5 service swift] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:31:20.907248 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ab275-9e41-488b-afd3-8fe0304a56b5 service swift] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:31:20.907524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ab275-9e41-488b-afd3-8fe0304a56b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:31:20.915400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ab275-9e41-488b-afd3-8fe0304a56b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:31:20.916960 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ab275-9e41-488b-afd3-8fe0304a56b5 service swift] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:31:20.924831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1221/2469] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:31:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:31:21.244713 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3927629-6d1c-474e-a3ff-b36df520dfd5 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:31:21.260497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3927629-6d1c-474e-a3ff-b36df520dfd5 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:31:21.268106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c9765-8b48-427c-a2fb-44cdb0b3b901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:31:21.268894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c9765-8b48-427c-a2fb-44cdb0b3b901 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:31:21.269286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c9765-8b48-427c-a2fb-44cdb0b3b901 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:31:21.269539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c9765-8b48-427c-a2fb-44cdb0b3b901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:31:21.272313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ba3c9765-8b48-427c-a2fb-44cdb0b3b901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:31:21.285698 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c9765-8b48-427c-a2fb-44cdb0b3b901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:31:21.290855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c9765-8b48-427c-a2fb-44cdb0b3b901 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:31:21.306474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1249/2470] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:31:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:31:24.894175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ab275-9e41-488b-afd3-8fe0304a56b5 service swift] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:31:24.904040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ab275-9e41-488b-afd3-8fe0304a56b5 service swift] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:31:24.907653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f3d9a-2f33-42c3-8b0a-2414475e467e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:31:24.908282 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f3d9a-2f33-42c3-8b0a-2414475e467e service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:31:24.908663 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f3d9a-2f33-42c3-8b0a-2414475e467e service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:31:24.908850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f3d9a-2f33-42c3-8b0a-2414475e467e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:31:24.918366 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f3d9a-2f33-42c3-8b0a-2414475e467e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:31:24.919708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f3d9a-2f33-42c3-8b0a-2414475e467e service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:31:24.929001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1222/2471] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:31:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:31:26.615815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c9765-8b48-427c-a2fb-44cdb0b3b901 service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:31:26.627783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c9765-8b48-427c-a2fb-44cdb0b3b901 service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:31:26.633187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3462d8e-f7d7-4eb4-8300-9f353b497a15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:31:26.633869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3462d8e-f7d7-4eb4-8300-9f353b497a15 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:31:26.634152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3462d8e-f7d7-4eb4-8300-9f353b497a15 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:31:26.634455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3462d8e-f7d7-4eb4-8300-9f353b497a15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:31:26.636181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e3462d8e-f7d7-4eb4-8300-9f353b497a15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:31:26.648468 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3462d8e-f7d7-4eb4-8300-9f353b497a15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:31:26.650093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3462d8e-f7d7-4eb4-8300-9f353b497a15 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:31:26.665493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1250/2472] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:31:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:31:27.537432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f3d9a-2f33-42c3-8b0a-2414475e467e service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:31:27.540056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-747f3d9a-2f33-42c3-8b0a-2414475e467e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:31:27.611084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f3d9a-2f33-42c3-8b0a-2414475e467e service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:31:27.615790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:31:27.616644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:31:27.616920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:31:27.617189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] PATH_INFO: `/v3/users/d01c35b046284938a73d4404234c1f24` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:31:27.618881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01c35b046284938a73d4404234c1f24)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:31:27.620789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:31:27.667718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01c35b046284938a73d4404234c1f24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:27.675003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01c35b046284938a73d4404234c1f24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:27.682134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01c35b046284938a73d4404234c1f24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:27.682775 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01c35b046284938a73d4404234c1f24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:27.683411 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01c35b046284938a73d4404234c1f24'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:27.701236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1223/2473] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:31:27 2022] DELETE /identity/v3/users/d01c35b046284938a73d4404234c1f24 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:31:27.870296 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3462d8e-f7d7-4eb4-8300-9f353b497a15 service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:31:27.884221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3462d8e-f7d7-4eb4-8300-9f353b497a15 service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:31:27.938900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:31:27.939761 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:31:27.940051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:31:27.940323 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] PATH_INFO: `/v3/projects/4d829832a67942c89c33adf4eea0df20` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:31:27.941477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d829832a67942c89c33adf4eea0df20)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:31:27.943401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:31:27.988473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d829832a67942c89c33adf4eea0df20', 'request_id': 'req-5fb0d242-c455-4fa2-9eb5-344259b6d797'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:27.995246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d829832a67942c89c33adf4eea0df20', 'request_id': 'req-5fb0d242-c455-4fa2-9eb5-344259b6d797'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:28.001210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d829832a67942c89c33adf4eea0df20', 'request_id': 'req-5fb0d242-c455-4fa2-9eb5-344259b6d797'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:28.011621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] The token cache is being invalidate because project 4d829832a67942c89c33adf4eea0df20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:31:28.011938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:28.012584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5fb0d242-c455-4fa2-9eb5-344259b6d797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:31:28.014118 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1251/2474] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:31:27 2022] DELETE /identity/v3/projects/4d829832a67942c89c33adf4eea0df20 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:31:37.757754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:31:37.760113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:31:37.832719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d342b-288d-42cd-90ac-c0b5853f32b2 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:31:37.893166 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:31:37.893817 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:31:37.894099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:31:37.894690 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:31:37.896451 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:31:37.951685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:31:37.953260 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:31:37.962078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1224/2475] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:31:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:32:06.914209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bb2cb-ce2f-46d6-bdba-ff8d4dd014db None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:32:06.914789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bb2cb-ce2f-46d6-bdba-ff8d4dd014db None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:32:06.914789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bb2cb-ce2f-46d6-bdba-ff8d4dd014db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:32:06.933168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3f5bb2cb-ce2f-46d6-bdba-ff8d4dd014db None None] MFA Rules not processed for user `b434038833084579adf853df718315b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:32:06.934413 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3f5bb2cb-ce2f-46d6-bdba-ff8d4dd014db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:32:06.941188 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1252/2476] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:32:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:32:12.284027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:32:12.285599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:32:12.300410 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccaa9d5-906e-471a-bb78-ad6ca4d60649 service nova] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:32:12.306986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:32:12.308553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:32:12.308553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:32:12.308553 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:32:12.310237 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:32:12.324618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:32:12.326212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:32:12.337011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1225/2477] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:32:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:32:38.638963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902b0de-4ecc-4b08-8e38-ddcfbe1b83c1 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:32:38.639586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902b0de-4ecc-4b08-8e38-ddcfbe1b83c1 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:32:38.639586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902b0de-4ecc-4b08-8e38-ddcfbe1b83c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:32:38.659517 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3902b0de-4ecc-4b08-8e38-ddcfbe1b83c1 None None] MFA Rules not processed for user `f0fad81c4cbd4335967e97fd7de9963d`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:32:38.661317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3902b0de-4ecc-4b08-8e38-ddcfbe1b83c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:32:38.722667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1253/2478] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:32:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:32:39.037837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:32:39.039323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:32:39.093560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b2b33-1c8d-4b2e-be60-c8d08ddc01f5 service nova] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:32:39.097042 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abca3e0-4ac7-4e05-b2f8-a6931cdf1f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:32:39.097675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca3e0-4ac7-4e05-b2f8-a6931cdf1f87 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:32:39.097955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca3e0-4ac7-4e05-b2f8-a6931cdf1f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:32:39.098225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca3e0-4ac7-4e05-b2f8-a6931cdf1f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:32:39.100624 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2abca3e0-4ac7-4e05-b2f8-a6931cdf1f87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:32:39.109634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abca3e0-4ac7-4e05-b2f8-a6931cdf1f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:32:39.111085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abca3e0-4ac7-4e05-b2f8-a6931cdf1f87 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:32:39.118676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1226/2479] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:32:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:32:39.423577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902b0de-4ecc-4b08-8e38-ddcfbe1b83c1 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:32:39.425152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3902b0de-4ecc-4b08-8e38-ddcfbe1b83c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:32:39.495572 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902b0de-4ecc-4b08-8e38-ddcfbe1b83c1 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:32:39.500396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c70af2-b094-4f8d-96ae-e54dd976b7d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92588782f32a472193340aba2bff8d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:32:39.501048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70af2-b094-4f8d-96ae-e54dd976b7d8 service placement] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:32:39.501330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70af2-b094-4f8d-96ae-e54dd976b7d8 service placement] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:32:39.501607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70af2-b094-4f8d-96ae-e54dd976b7d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:32:39.503355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-99c70af2-b094-4f8d-96ae-e54dd976b7d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:32:39.514884 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c70af2-b094-4f8d-96ae-e54dd976b7d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:32:39.516442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c70af2-b094-4f8d-96ae-e54dd976b7d8 service placement] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:32:39.527356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1254/2480] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:32:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:19.075875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f80e20-87d2-451c-9787-7d9f5972d209 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:19.076491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f80e20-87d2-451c-9787-7d9f5972d209 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:19.076491 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f80e20-87d2-451c-9787-7d9f5972d209 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:19.077810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1227/2481] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:33:19.085014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce609ae-9a06-4744-a7fe-aa949e49153a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:19.085563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce609ae-9a06-4744-a7fe-aa949e49153a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:19.086027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce609ae-9a06-4744-a7fe-aa949e49153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:19.119396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-dce609ae-9a06-4744-a7fe-aa949e49153a None None] MFA Rules not processed for user `a99a9951d83446efbf819b72836afc2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:19.120667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-dce609ae-9a06-4744-a7fe-aa949e49153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:19.133591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1255/2482] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:33:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:19.147440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f80e20-87d2-451c-9787-7d9f5972d209 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:19.159439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f80e20-87d2-451c-9787-7d9f5972d209 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:19.163069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b8261-1ffe-4d70-8b6d-664be6866112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:19.163913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8261-1ffe-4d70-8b6d-664be6866112 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:19.164353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8261-1ffe-4d70-8b6d-664be6866112 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:19.164783 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8261-1ffe-4d70-8b6d-664be6866112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:19.174369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b8261-1ffe-4d70-8b6d-664be6866112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:19.176800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b8261-1ffe-4d70-8b6d-664be6866112 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:19.190610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1228/2483] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:33:19.289683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42686c2d-0061-45d2-87d1-272c8ed15865 None None] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:19.290149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42686c2d-0061-45d2-87d1-272c8ed15865 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:19.290629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42686c2d-0061-45d2-87d1-272c8ed15865 None None] PATH_INFO: `/` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:19.292678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1256/2484] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:33:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:33:19.299289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ee357-6df6-4f89-b3bd-c0c5b527c68d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:19.299579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ee357-6df6-4f89-b3bd-c0c5b527c68d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:19.299859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ee357-6df6-4f89-b3bd-c0c5b527c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:19.318892 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-945ee357-6df6-4f89-b3bd-c0c5b527c68d None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:19.320084 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-945ee357-6df6-4f89-b3bd-c0c5b527c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:19.329467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1229/2485] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:33:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:19.340743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42686c2d-0061-45d2-87d1-272c8ed15865 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:19.351864 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42686c2d-0061-45d2-87d1-272c8ed15865 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:19.355248 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d6e1-28f1-4f83-a6ba-60aeb1f405e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:19.355887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d6e1-28f1-4f83-a6ba-60aeb1f405e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:19.356166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d6e1-28f1-4f83-a6ba-60aeb1f405e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:19.356437 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d6e1-28f1-4f83-a6ba-60aeb1f405e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:19.366636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8d6e1-28f1-4f83-a6ba-60aeb1f405e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:19.368280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8d6e1-28f1-4f83-a6ba-60aeb1f405e5 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:19.379498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1257/2486] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:32.472426 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ee357-6df6-4f89-b3bd-c0c5b527c68d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:32.482206 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ee357-6df6-4f89-b3bd-c0c5b527c68d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:32.485752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48921554-a2ab-4a9f-b00e-da9edb7b567d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:32.486446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48921554-a2ab-4a9f-b00e-da9edb7b567d service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:32.486751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48921554-a2ab-4a9f-b00e-da9edb7b567d service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:32.487026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48921554-a2ab-4a9f-b00e-da9edb7b567d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:32.488818 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-48921554-a2ab-4a9f-b00e-da9edb7b567d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:32.548627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48921554-a2ab-4a9f-b00e-da9edb7b567d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:32.550037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48921554-a2ab-4a9f-b00e-da9edb7b567d service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:32.559481 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1230/2487] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:36.129609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d6e1-28f1-4f83-a6ba-60aeb1f405e5 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:36.131669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-89d8d6e1-28f1-4f83-a6ba-60aeb1f405e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:36.149367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d6e1-28f1-4f83-a6ba-60aeb1f405e5 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:36.154339 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:36.155442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.155727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.156003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] PATH_INFO: `/v3/users/b434038833084579adf853df718315b2` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.157185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b434038833084579adf853df718315b2)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:36.159245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:36.205285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b434038833084579adf853df718315b2'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.212523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b434038833084579adf853df718315b2'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.220135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b434038833084579adf853df718315b2'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.220758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b434038833084579adf853df718315b2'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.221433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b2105b8f-64e1-469d-84e8-3003df5f2a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b434038833084579adf853df718315b2'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.239744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1258/2488] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:33:36 2022] DELETE /identity/v3/users/b434038833084579adf853df718315b2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:36.410094 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48921554-a2ab-4a9f-b00e-da9edb7b567d service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:36.421754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48921554-a2ab-4a9f-b00e-da9edb7b567d service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:36.476941 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:36.477795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.478083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.478391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] PATH_INFO: `/v3/projects/7bdba79df5fc4c3faa187bd65479d3f7` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.479556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bdba79df5fc4c3faa187bd65479d3f7)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:36.481453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:36.527463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bdba79df5fc4c3faa187bd65479d3f7', 'request_id': 'req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.533300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bdba79df5fc4c3faa187bd65479d3f7', 'request_id': 'req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.538513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bdba79df5fc4c3faa187bd65479d3f7', 'request_id': 'req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.549913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] The token cache is being invalidate because project 7bdba79df5fc4c3faa187bd65479d3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:33:36.550198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.550904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-1b4dd477-7af1-4ca5-8c4d-65035a9c5c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:36.552466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1231/2489] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:33:36 2022] DELETE /identity/v3/projects/7bdba79df5fc4c3faa187bd65479d3f7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:36.557537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3a7ed-e95c-4870-8835-070c1df1b265 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.557856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3a7ed-e95c-4870-8835-070c1df1b265 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.558168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3a7ed-e95c-4870-8835-070c1df1b265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.576732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-aef3a7ed-e95c-4870-8835-070c1df1b265 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:36.577924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-aef3a7ed-e95c-4870-8835-070c1df1b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:36.640227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1259/2490] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:33:36.648242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72f617-7ccb-46c8-946a-dbe35a83d657 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.648536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72f617-7ccb-46c8-946a-dbe35a83d657 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.648821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72f617-7ccb-46c8-946a-dbe35a83d657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.667431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-4c72f617-7ccb-46c8-946a-dbe35a83d657 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:36.668567 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4c72f617-7ccb-46c8-946a-dbe35a83d657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:36.677085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1232/2491] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:36.682825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3a7ed-e95c-4870-8835-070c1df1b265 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:36.693141 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3a7ed-e95c-4870-8835-070c1df1b265 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:36.698147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41323d-06ec-45f9-a7f7-7757480d9fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:36.698827 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41323d-06ec-45f9-a7f7-7757480d9fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.699107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41323d-06ec-45f9-a7f7-7757480d9fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.699379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41323d-06ec-45f9-a7f7-7757480d9fa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.700091 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41323d-06ec-45f9-a7f7-7757480d9fa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:33:36.700392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41323d-06ec-45f9-a7f7-7757480d9fa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:36.701961 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41323d-06ec-45f9-a7f7-7757480d9fa8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:36.713530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1260/2492] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:33:36.717773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72f617-7ccb-46c8-946a-dbe35a83d657 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:36.727144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72f617-7ccb-46c8-946a-dbe35a83d657 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:36.731904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bd809-455c-4498-b865-f94144f02b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:36.732569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bd809-455c-4498-b865-f94144f02b95 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.732841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bd809-455c-4498-b865-f94144f02b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.733124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bd809-455c-4498-b865-f94144f02b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.733806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bd809-455c-4498-b865-f94144f02b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:36.735727 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bd809-455c-4498-b865-f94144f02b95 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:36.770185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1233/2493] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:33:36 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:33:36.774237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41323d-06ec-45f9-a7f7-7757480d9fa8 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:36.783929 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41323d-06ec-45f9-a7f7-7757480d9fa8 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:36.838274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5bd29-b6cc-461b-837b-63f2b28975cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:36.838945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5bd29-b6cc-461b-837b-63f2b28975cd admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.839227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5bd29-b6cc-461b-837b-63f2b28975cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.839498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5bd29-b6cc-461b-837b-63f2b28975cd admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.840172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5bd29-b6cc-461b-837b-63f2b28975cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:36.842055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5bd29-b6cc-461b-837b-63f2b28975cd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:36.861153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1261/2494] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:33:36 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:33:36.865838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bd809-455c-4498-b865-f94144f02b95 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:36.875773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bd809-455c-4498-b865-f94144f02b95 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:36.881415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47b669-6879-4c7a-9bf7-a80da3be1b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:36.882071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47b669-6879-4c7a-9bf7-a80da3be1b53 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.882371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47b669-6879-4c7a-9bf7-a80da3be1b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.882671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47b669-6879-4c7a-9bf7-a80da3be1b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.883395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47b669-6879-4c7a-9bf7-a80da3be1b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:36.884981 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47b669-6879-4c7a-9bf7-a80da3be1b53 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:36.895924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1234/2495] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:36.899985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5bd29-b6cc-461b-837b-63f2b28975cd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:36.910612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5bd29-b6cc-461b-837b-63f2b28975cd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:36.915178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84cdc79-6222-4c8a-aed4-05582798117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:36.915823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cdc79-6222-4c8a-aed4-05582798117c admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.916102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cdc79-6222-4c8a-aed4-05582798117c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.916373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cdc79-6222-4c8a-aed4-05582798117c admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.917078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cdc79-6222-4c8a-aed4-05582798117c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:36.918769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84cdc79-6222-4c8a-aed4-05582798117c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:36.928668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1262/2496] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:36.932724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47b669-6879-4c7a-9bf7-a80da3be1b53 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:36.942279 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47b669-6879-4c7a-9bf7-a80da3be1b53 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:36.947106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6809e1-2f9f-4bdb-a510-888f368a9e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:36.947969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6809e1-2f9f-4bdb-a510-888f368a9e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.948253 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6809e1-2f9f-4bdb-a510-888f368a9e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.948528 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6809e1-2f9f-4bdb-a510-888f368a9e4e admin admin] PATH_INFO: `/v3/projects/d53808f22dd44841a17e2d6d83faa37a/users/8614ec94282d4972bbbacaaa2bdcb600/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:36.963132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6809e1-2f9f-4bdb-a510-888f368a9e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53808f22dd44841a17e2d6d83faa37a, user_id=8614ec94282d4972bbbacaaa2bdcb600, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:36.965772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6809e1-2f9f-4bdb-a510-888f368a9e4e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:36.978785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1235/2497] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:33:36 2022] PUT /identity/v3/projects/d53808f22dd44841a17e2d6d83faa37a/users/8614ec94282d4972bbbacaaa2bdcb600/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:36.989712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f536cf4-a348-4b3a-b2e8-2e980de01c12 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:36.990004 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f536cf4-a348-4b3a-b2e8-2e980de01c12 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:36.990304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f536cf4-a348-4b3a-b2e8-2e980de01c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:37.017117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0f536cf4-a348-4b3a-b2e8-2e980de01c12 None None] MFA Rules not processed for user `8614ec94282d4972bbbacaaa2bdcb600`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:37.018341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0f536cf4-a348-4b3a-b2e8-2e980de01c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:37.078445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1263/2498] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:37.090343 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6809e1-2f9f-4bdb-a510-888f368a9e4e admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:37.092008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-da6809e1-2f9f-4bdb-a510-888f368a9e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:37.162126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6809e1-2f9f-4bdb-a510-888f368a9e4e admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:37.167685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c573c-5f23-4f8c-a9ac-0f370b3f39d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:37.168328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c573c-5f23-4f8c-a9ac-0f370b3f39d2 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:37.168618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c573c-5f23-4f8c-a9ac-0f370b3f39d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:37.168949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c573c-5f23-4f8c-a9ac-0f370b3f39d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:37.176612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c573c-5f23-4f8c-a9ac-0f370b3f39d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:37.178184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c573c-5f23-4f8c-a9ac-0f370b3f39d2 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:37.186744 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1236/2499] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:46.500423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f536cf4-a348-4b3a-b2e8-2e980de01c12 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:46.561182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f536cf4-a348-4b3a-b2e8-2e980de01c12 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:46.566304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:46.567179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:46.567467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:46.567742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] PATH_INFO: `/v3/users/8614ec94282d4972bbbacaaa2bdcb600` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:46.569121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8614ec94282d4972bbbacaaa2bdcb600)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:46.571637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:46.618631 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8614ec94282d4972bbbacaaa2bdcb600'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:46.627097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8614ec94282d4972bbbacaaa2bdcb600'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:46.636037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8614ec94282d4972bbbacaaa2bdcb600'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:46.636734 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8614ec94282d4972bbbacaaa2bdcb600'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:46.637376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8614ec94282d4972bbbacaaa2bdcb600'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:46.654444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1264/2500] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:33:46 2022] DELETE /identity/v3/users/8614ec94282d4972bbbacaaa2bdcb600 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:46.659439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a44b3c-cc2f-4e92-b3da-003623b1f403 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:46.659909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a44b3c-cc2f-4e92-b3da-003623b1f403 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:46.659996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a44b3c-cc2f-4e92-b3da-003623b1f403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:46.678128 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-00a44b3c-cc2f-4e92-b3da-003623b1f403 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:46.679380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-00a44b3c-cc2f-4e92-b3da-003623b1f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:46.737180 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1237/2501] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:33:46.746720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:46.748218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:46.807678 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0080849-38a5-4bcf-99c4-5d0ebe73156a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:46.811274 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adbff4-b6cb-4314-9d7c-73ac67ae12f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:46.811919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adbff4-b6cb-4314-9d7c-73ac67ae12f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:46.812205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adbff4-b6cb-4314-9d7c-73ac67ae12f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:46.812481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adbff4-b6cb-4314-9d7c-73ac67ae12f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:46.822964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adbff4-b6cb-4314-9d7c-73ac67ae12f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:46.824401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adbff4-b6cb-4314-9d7c-73ac67ae12f2 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:46.833946 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1265/2502] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:33:47.195616 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a44b3c-cc2f-4e92-b3da-003623b1f403 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:47.197540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-00a44b3c-cc2f-4e92-b3da-003623b1f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:47.210615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a44b3c-cc2f-4e92-b3da-003623b1f403 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:47.216631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:47.217566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.217915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.218296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] PATH_INFO: `/v3/projects/d53808f22dd44841a17e2d6d83faa37a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.219667 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53808f22dd44841a17e2d6d83faa37a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:47.221643 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:47.273073 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53808f22dd44841a17e2d6d83faa37a', 'request_id': 'req-30f588bc-2595-421c-aedf-2a5f614f81c7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:47.279204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53808f22dd44841a17e2d6d83faa37a', 'request_id': 'req-30f588bc-2595-421c-aedf-2a5f614f81c7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:47.284853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53808f22dd44841a17e2d6d83faa37a', 'request_id': 'req-30f588bc-2595-421c-aedf-2a5f614f81c7'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:47.304259 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] The token cache is being invalidate because project d53808f22dd44841a17e2d6d83faa37a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:33:47.304552 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:47.305178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-30f588bc-2595-421c-aedf-2a5f614f81c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:47.306814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1238/2503] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:33:47 2022] DELETE /identity/v3/projects/d53808f22dd44841a17e2d6d83faa37a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:47.311626 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb765c-d6fc-46ec-bd82-f283fc50afae None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.311914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb765c-d6fc-46ec-bd82-f283fc50afae None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.312228 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb765c-d6fc-46ec-bd82-f283fc50afae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.330767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-bceb765c-d6fc-46ec-bd82-f283fc50afae None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:47.332544 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bceb765c-d6fc-46ec-bd82-f283fc50afae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:47.390960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1266/2504] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:47.398924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafff4f-93c1-4d1e-8759-97260b5c4396 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.399212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafff4f-93c1-4d1e-8759-97260b5c4396 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.399494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafff4f-93c1-4d1e-8759-97260b5c4396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.417253 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fcafff4f-93c1-4d1e-8759-97260b5c4396 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:47.418556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fcafff4f-93c1-4d1e-8759-97260b5c4396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:47.427988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1239/2505] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:47.431927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb765c-d6fc-46ec-bd82-f283fc50afae None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:47.441752 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb765c-d6fc-46ec-bd82-f283fc50afae None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:47.446811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4eff-41d0-4748-bcb4-4a62b5f67048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:47.447467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4eff-41d0-4748-bcb4-4a62b5f67048 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.447748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4eff-41d0-4748-bcb4-4a62b5f67048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.448026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4eff-41d0-4748-bcb4-4a62b5f67048 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.448739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4eff-41d0-4748-bcb4-4a62b5f67048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:33:47.449038 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4eff-41d0-4748-bcb4-4a62b5f67048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:47.450683 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4eff-41d0-4748-bcb4-4a62b5f67048 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:47.464005 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1267/2506] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:33:47.468363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafff4f-93c1-4d1e-8759-97260b5c4396 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:47.477695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafff4f-93c1-4d1e-8759-97260b5c4396 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:47.483195 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b406b-4e9b-4cbb-ad95-354f41830818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:47.484229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b406b-4e9b-4cbb-ad95-354f41830818 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.484511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b406b-4e9b-4cbb-ad95-354f41830818 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.484781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b406b-4e9b-4cbb-ad95-354f41830818 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.485469 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b406b-4e9b-4cbb-ad95-354f41830818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:47.487439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b406b-4e9b-4cbb-ad95-354f41830818 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:47.517129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1240/2507] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:33:47 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:33:47.521265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4eff-41d0-4748-bcb4-4a62b5f67048 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:47.531430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4eff-41d0-4748-bcb4-4a62b5f67048 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:47.589885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357431a-81a8-499f-8ea3-2bbbfbd6584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:47.590849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357431a-81a8-499f-8ea3-2bbbfbd6584f admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.590940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357431a-81a8-499f-8ea3-2bbbfbd6584f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.592545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357431a-81a8-499f-8ea3-2bbbfbd6584f admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.592545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357431a-81a8-499f-8ea3-2bbbfbd6584f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:47.593854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357431a-81a8-499f-8ea3-2bbbfbd6584f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:47.618137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1268/2508] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:33:47 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:33:47.621839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b406b-4e9b-4cbb-ad95-354f41830818 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:47.633425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b406b-4e9b-4cbb-ad95-354f41830818 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:47.638848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccaf071-1bb6-4d04-8a00-0014d9e7b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:47.639648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaf071-1bb6-4d04-8a00-0014d9e7b837 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.639933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaf071-1bb6-4d04-8a00-0014d9e7b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.640209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccaf071-1bb6-4d04-8a00-0014d9e7b837 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.641085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccaf071-1bb6-4d04-8a00-0014d9e7b837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:47.643003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccaf071-1bb6-4d04-8a00-0014d9e7b837 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:47.657998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1241/2509] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:47.659568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357431a-81a8-499f-8ea3-2bbbfbd6584f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:47.670562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357431a-81a8-499f-8ea3-2bbbfbd6584f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:47.675266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7ddcd9-a04a-48e7-906f-7f11b15e8a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:47.675960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ddcd9-a04a-48e7-906f-7f11b15e8a20 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.676241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ddcd9-a04a-48e7-906f-7f11b15e8a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.676516 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7ddcd9-a04a-48e7-906f-7f11b15e8a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.677233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ddcd9-a04a-48e7-906f-7f11b15e8a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:47.678856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7ddcd9-a04a-48e7-906f-7f11b15e8a20 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:47.689340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1269/2510] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:47.693955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccaf071-1bb6-4d04-8a00-0014d9e7b837 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:47.703647 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccaf071-1bb6-4d04-8a00-0014d9e7b837 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:47.710116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1724396-e739-48e4-8b82-a8bb89e03a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:47.711095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724396-e739-48e4-8b82-a8bb89e03a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.711604 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724396-e739-48e4-8b82-a8bb89e03a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.712416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724396-e739-48e4-8b82-a8bb89e03a83 admin admin] PATH_INFO: `/v3/projects/7807c9a082a54bb6bd868231f95a9d50/users/42437e6414d5445c94d478a658120c92/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.733130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1724396-e739-48e4-8b82-a8bb89e03a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7807c9a082a54bb6bd868231f95a9d50, user_id=42437e6414d5445c94d478a658120c92, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:47.735724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1724396-e739-48e4-8b82-a8bb89e03a83 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:47.758347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1242/2511] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:33:47 2022] PUT /identity/v3/projects/7807c9a082a54bb6bd868231f95a9d50/users/42437e6414d5445c94d478a658120c92/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:47.760817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0adf8-04a7-491e-be21-a7edda614886 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.761162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0adf8-04a7-491e-be21-a7edda614886 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.761444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0adf8-04a7-491e-be21-a7edda614886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.782628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d4f0adf8-04a7-491e-be21-a7edda614886 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:47.784655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d4f0adf8-04a7-491e-be21-a7edda614886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:47.844593 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1270/2512] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:47.856925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1724396-e739-48e4-8b82-a8bb89e03a83 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:47.858880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a1724396-e739-48e4-8b82-a8bb89e03a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:47.915879 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1724396-e739-48e4-8b82-a8bb89e03a83 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:47.919435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441cdc6-50f5-41d7-aa58-2bd88500ed30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:47.920071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441cdc6-50f5-41d7-aa58-2bd88500ed30 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:47.920350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441cdc6-50f5-41d7-aa58-2bd88500ed30 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:47.920626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441cdc6-50f5-41d7-aa58-2bd88500ed30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:47.930770 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441cdc6-50f5-41d7-aa58-2bd88500ed30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:47.932724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441cdc6-50f5-41d7-aa58-2bd88500ed30 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:47.943285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1243/2513] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:48.825732 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5836a1-bf1a-4ddd-8bc0-993fa8c3cd74 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:48.826279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5836a1-bf1a-4ddd-8bc0-993fa8c3cd74 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:48.826279 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5836a1-bf1a-4ddd-8bc0-993fa8c3cd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:48.853017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4d5836a1-bf1a-4ddd-8bc0-993fa8c3cd74 None None] MFA Rules not processed for user `42437e6414d5445c94d478a658120c92`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:48.854220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4d5836a1-bf1a-4ddd-8bc0-993fa8c3cd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:48.928945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1271/2514] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:48.930196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441cdc6-50f5-41d7-aa58-2bd88500ed30 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:48.940836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441cdc6-50f5-41d7-aa58-2bd88500ed30 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:48.946370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd070b5-7ff5-4dac-a39a-e42b8e503404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:48.947221 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd070b5-7ff5-4dac-a39a-e42b8e503404 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:48.947691 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd070b5-7ff5-4dac-a39a-e42b8e503404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:48.948141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd070b5-7ff5-4dac-a39a-e42b8e503404 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:48.949044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd070b5-7ff5-4dac-a39a-e42b8e503404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:48.951707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd070b5-7ff5-4dac-a39a-e42b8e503404 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:48.993610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1244/2515] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:33:48 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:33:48.997446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5836a1-bf1a-4ddd-8bc0-993fa8c3cd74 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:49.011841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5836a1-bf1a-4ddd-8bc0-993fa8c3cd74 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:49.072524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ead95d-588c-4f50-b630-45504e052cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:49.073196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ead95d-588c-4f50-b630-45504e052cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:49.073480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ead95d-588c-4f50-b630-45504e052cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:49.073757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ead95d-588c-4f50-b630-45504e052cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:49.074479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ead95d-588c-4f50-b630-45504e052cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:49.076463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ead95d-588c-4f50-b630-45504e052cf9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:49.098514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1272/2516] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:33:48 2022] POST /identity/v3/users => generated 309 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:33:49.102759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd070b5-7ff5-4dac-a39a-e42b8e503404 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:49.113444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd070b5-7ff5-4dac-a39a-e42b8e503404 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:49.118039 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a53e2-063f-4b3a-86ec-b158f0cd83b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:49.118815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a53e2-063f-4b3a-86ec-b158f0cd83b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:49.119099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a53e2-063f-4b3a-86ec-b158f0cd83b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:49.119372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a53e2-063f-4b3a-86ec-b158f0cd83b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:49.120092 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a53e2-063f-4b3a-86ec-b158f0cd83b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:49.121727 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a53e2-063f-4b3a-86ec-b158f0cd83b2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:49.133192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1245/2517] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:49.137290 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ead95d-588c-4f50-b630-45504e052cf9 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:49.148511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ead95d-588c-4f50-b630-45504e052cf9 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:49.153061 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82851ebd-7c52-42cd-9c84-b4d528d995dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:49.153944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82851ebd-7c52-42cd-9c84-b4d528d995dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:49.154223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82851ebd-7c52-42cd-9c84-b4d528d995dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:49.154531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82851ebd-7c52-42cd-9c84-b4d528d995dd admin admin] PATH_INFO: `/v3/projects/c0686b7420b2493f94c47b0a3a3d5b24/users/d970866f999d456285dc0b8488b96e63/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:49.168918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82851ebd-7c52-42cd-9c84-b4d528d995dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0686b7420b2493f94c47b0a3a3d5b24, user_id=d970866f999d456285dc0b8488b96e63, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:49.171738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82851ebd-7c52-42cd-9c84-b4d528d995dd admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:49.184887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1273/2518] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:33:49 2022] PUT /identity/v3/projects/c0686b7420b2493f94c47b0a3a3d5b24/users/d970866f999d456285dc0b8488b96e63/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:49.189171 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a53e2-063f-4b3a-86ec-b158f0cd83b2 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:49.199765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a53e2-063f-4b3a-86ec-b158f0cd83b2 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:49.255903 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4edc2c-3691-4083-97a7-fa98b4f14203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:49.256577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4edc2c-3691-4083-97a7-fa98b4f14203 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:49.256860 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4edc2c-3691-4083-97a7-fa98b4f14203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:49.257132 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4edc2c-3691-4083-97a7-fa98b4f14203 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:49.257850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4edc2c-3691-4083-97a7-fa98b4f14203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:49.259477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4edc2c-3691-4083-97a7-fa98b4f14203 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:49.269383 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1246/2519] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:33:49.273878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82851ebd-7c52-42cd-9c84-b4d528d995dd admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:49.285511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82851ebd-7c52-42cd-9c84-b4d528d995dd admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:49.290062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede27feb-a8a4-474e-86c7-23422300e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:49.290973 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27feb-a8a4-474e-86c7-23422300e2be admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:49.291258 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27feb-a8a4-474e-86c7-23422300e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:49.291535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede27feb-a8a4-474e-86c7-23422300e2be admin admin] PATH_INFO: `/v3/projects/c0686b7420b2493f94c47b0a3a3d5b24/users/d970866f999d456285dc0b8488b96e63/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:49.293562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede27feb-a8a4-474e-86c7-23422300e2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0686b7420b2493f94c47b0a3a3d5b24, user_id=d970866f999d456285dc0b8488b96e63, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:49.296192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede27feb-a8a4-474e-86c7-23422300e2be admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:49.307699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1274/2520] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:33:49 2022] PUT /identity/v3/projects/c0686b7420b2493f94c47b0a3a3d5b24/users/d970866f999d456285dc0b8488b96e63/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:49.424726 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af912d0-fd1f-4a38-a112-d61e1bb7d7de None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:49.424971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af912d0-fd1f-4a38-a112-d61e1bb7d7de None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:49.425249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af912d0-fd1f-4a38-a112-d61e1bb7d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:49.445568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-7af912d0-fd1f-4a38-a112-d61e1bb7d7de None None] MFA Rules not processed for user `e548e01902ba41e79667ed56d602f19a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:49.446820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7af912d0-fd1f-4a38-a112-d61e1bb7d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:49.511415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1247/2521] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:49.884863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede27feb-a8a4-474e-86c7-23422300e2be admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:49.887112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ede27feb-a8a4-474e-86c7-23422300e2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:49.948315 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede27feb-a8a4-474e-86c7-23422300e2be admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:49.953203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f19aa-d647-460a-add6-037c69d3d4b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:49.954018 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f19aa-d647-460a-add6-037c69d3d4b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:49.954458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f19aa-d647-460a-add6-037c69d3d4b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:49.954747 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f19aa-d647-460a-add6-037c69d3d4b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:49.956970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-292f19aa-d647-460a-add6-037c69d3d4b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:49.973064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f19aa-d647-460a-add6-037c69d3d4b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:49.974555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f19aa-d647-460a-add6-037c69d3d4b9 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:49.984752 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1275/2522] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:49.993049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40245e80-6373-44e1-a98c-acaf21cd91c7 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:49.993966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40245e80-6373-44e1-a98c-acaf21cd91c7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:49.994465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40245e80-6373-44e1-a98c-acaf21cd91c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:50.025452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-40245e80-6373-44e1-a98c-acaf21cd91c7 None None] MFA Rules not processed for user `d970866f999d456285dc0b8488b96e63`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:50.026846 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-40245e80-6373-44e1-a98c-acaf21cd91c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:50.098201 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1248/2523] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:51.119470 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f19aa-d647-460a-add6-037c69d3d4b9 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:51.182507 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f19aa-d647-460a-add6-037c69d3d4b9 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:51.186948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:51.187805 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:51.188088 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:51.188358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] PATH_INFO: `/v3/users/42437e6414d5445c94d478a658120c92` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:51.189526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42437e6414d5445c94d478a658120c92)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:51.191494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:51.382098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42437e6414d5445c94d478a658120c92'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.399283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42437e6414d5445c94d478a658120c92'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.408831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42437e6414d5445c94d478a658120c92'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.409967 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42437e6414d5445c94d478a658120c92'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.410824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42437e6414d5445c94d478a658120c92'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.442435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1276/2524] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:33:51 2022] DELETE /identity/v3/users/42437e6414d5445c94d478a658120c92 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:51.674025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40245e80-6373-44e1-a98c-acaf21cd91c7 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:51.685123 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40245e80-6373-44e1-a98c-acaf21cd91c7 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:51.746893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:51.747755 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:51.748205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:51.748618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] PATH_INFO: `/v3/projects/7807c9a082a54bb6bd868231f95a9d50` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:51.750018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7807c9a082a54bb6bd868231f95a9d50)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:51.752005 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:51.806261 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7807c9a082a54bb6bd868231f95a9d50', 'request_id': 'req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.813118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7807c9a082a54bb6bd868231f95a9d50', 'request_id': 'req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.819122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7807c9a082a54bb6bd868231f95a9d50', 'request_id': 'req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.837157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] The token cache is being invalidate because project 7807c9a082a54bb6bd868231f95a9d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:33:51.837669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.838466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.840531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1249/2525] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:33:51 2022] DELETE /identity/v3/projects/7807c9a082a54bb6bd868231f95a9d50 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:51.844623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:51.846185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:51.860479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86646eb-e2d5-4064-b841-391738f7e610 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:51.919524 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:51.920320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:51.920633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:51.920909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] PATH_INFO: `/v3/users/d970866f999d456285dc0b8488b96e63` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:51.922205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d970866f999d456285dc0b8488b96e63)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:51.924191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:51.969266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd970866f999d456285dc0b8488b96e63'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.976731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd970866f999d456285dc0b8488b96e63'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.983911 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd970866f999d456285dc0b8488b96e63'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.985330 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd970866f999d456285dc0b8488b96e63'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:51.985953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-7b2e8dd7-bf2e-4649-bbba-7c0a705af330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd970866f999d456285dc0b8488b96e63'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:52.003662 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1277/2526] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:33:51 2022] DELETE /identity/v3/users/d970866f999d456285dc0b8488b96e63 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:52.175685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:52.177137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:52.197875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5733bb-3d53-4f4f-aab4-edba9aff19d1 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:52.272642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:52.273533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.273820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.274125 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] PATH_INFO: `/v3/projects/c0686b7420b2493f94c47b0a3a3d5b24` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.275593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0686b7420b2493f94c47b0a3a3d5b24)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:52.277661 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:52.332489 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0686b7420b2493f94c47b0a3a3d5b24', 'request_id': 'req-502f942a-c003-490d-9ede-b02e2bdda93c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:52.339537 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0686b7420b2493f94c47b0a3a3d5b24', 'request_id': 'req-502f942a-c003-490d-9ede-b02e2bdda93c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:52.345474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0686b7420b2493f94c47b0a3a3d5b24', 'request_id': 'req-502f942a-c003-490d-9ede-b02e2bdda93c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:52.360330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] The token cache is being invalidate because project c0686b7420b2493f94c47b0a3a3d5b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:33:52.360702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:52.361466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-502f942a-c003-490d-9ede-b02e2bdda93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:52.364026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1250/2527] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:33:52 2022] DELETE /identity/v3/projects/c0686b7420b2493f94c47b0a3a3d5b24 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:52.368699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d07bb0-1e6a-4691-bf37-891360c28833 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.369204 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d07bb0-1e6a-4691-bf37-891360c28833 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.369322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d07bb0-1e6a-4691-bf37-891360c28833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.389194 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-e2d07bb0-1e6a-4691-bf37-891360c28833 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:52.390774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-e2d07bb0-1e6a-4691-bf37-891360c28833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:52.460241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1278/2528] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:52.468028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3bcf4-ce5b-4e14-b97c-3ee9ad67f635 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.468506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3bcf4-ce5b-4e14-b97c-3ee9ad67f635 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.468790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3bcf4-ce5b-4e14-b97c-3ee9ad67f635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.487956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-9ba3bcf4-ce5b-4e14-b97c-3ee9ad67f635 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:52.489164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9ba3bcf4-ce5b-4e14-b97c-3ee9ad67f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:52.497085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1251/2529] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:52.501287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d07bb0-1e6a-4691-bf37-891360c28833 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:52.510774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d07bb0-1e6a-4691-bf37-891360c28833 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:52.515499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f883569-3d0e-44fd-aa59-2c4f703dcb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:52.516411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f883569-3d0e-44fd-aa59-2c4f703dcb37 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.516704 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f883569-3d0e-44fd-aa59-2c4f703dcb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.517007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f883569-3d0e-44fd-aa59-2c4f703dcb37 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.517757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f883569-3d0e-44fd-aa59-2c4f703dcb37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:33:52.518826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f883569-3d0e-44fd-aa59-2c4f703dcb37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:52.520526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f883569-3d0e-44fd-aa59-2c4f703dcb37 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:52.532068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1279/2530] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:33:52.536945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3bcf4-ce5b-4e14-b97c-3ee9ad67f635 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:52.548231 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3bcf4-ce5b-4e14-b97c-3ee9ad67f635 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:52.555001 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4b176-b5cb-4138-a10b-21961eb121bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:52.555709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4b176-b5cb-4138-a10b-21961eb121bf admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.556077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4b176-b5cb-4138-a10b-21961eb121bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.556640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b4b176-b5cb-4138-a10b-21961eb121bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.557444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4b176-b5cb-4138-a10b-21961eb121bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:52.559769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b4b176-b5cb-4138-a10b-21961eb121bf admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:52.590328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1252/2531] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:33:52 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:33:52.594512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f883569-3d0e-44fd-aa59-2c4f703dcb37 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:52.604999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f883569-3d0e-44fd-aa59-2c4f703dcb37 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:52.683789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f19ed-9802-45e9-b541-5082832294c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:52.684560 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f19ed-9802-45e9-b541-5082832294c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.684970 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f19ed-9802-45e9-b541-5082832294c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.685564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f19ed-9802-45e9-b541-5082832294c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.686364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f19ed-9802-45e9-b541-5082832294c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:52.688346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f19ed-9802-45e9-b541-5082832294c8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:52.711644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1280/2532] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:33:52 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:33:52.716022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4b176-b5cb-4138-a10b-21961eb121bf admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:52.727786 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b4b176-b5cb-4138-a10b-21961eb121bf admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:52.737032 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0084378-abb4-4563-9461-417e1ae86b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:52.738165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0084378-abb4-4563-9461-417e1ae86b23 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.738694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0084378-abb4-4563-9461-417e1ae86b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.739157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0084378-abb4-4563-9461-417e1ae86b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.740109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0084378-abb4-4563-9461-417e1ae86b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:52.742237 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0084378-abb4-4563-9461-417e1ae86b23 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:52.755379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1253/2533] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:52.759601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f19ed-9802-45e9-b541-5082832294c8 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:52.775237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f19ed-9802-45e9-b541-5082832294c8 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:52.780792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7782d-ef59-426b-bc49-ec2e4040bcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:52.781484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7782d-ef59-426b-bc49-ec2e4040bcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.781764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7782d-ef59-426b-bc49-ec2e4040bcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.782039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7782d-ef59-426b-bc49-ec2e4040bcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.782806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7782d-ef59-426b-bc49-ec2e4040bcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:52.784477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7782d-ef59-426b-bc49-ec2e4040bcf5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:52.797233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1281/2534] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:33:52.801559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0084378-abb4-4563-9461-417e1ae86b23 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:52.816137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0084378-abb4-4563-9461-417e1ae86b23 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:52.821606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c112ec-bf9d-4009-b1dc-af512d56ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:52.822714 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c112ec-bf9d-4009-b1dc-af512d56ddcf admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.823101 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c112ec-bf9d-4009-b1dc-af512d56ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.823457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c112ec-bf9d-4009-b1dc-af512d56ddcf admin admin] PATH_INFO: `/v3/projects/317b8a7454204073926be40258dccfa2/users/70d925c80e6d4ef2a7dd479c1e2b93cb/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.840870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c112ec-bf9d-4009-b1dc-af512d56ddcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=317b8a7454204073926be40258dccfa2, user_id=70d925c80e6d4ef2a7dd479c1e2b93cb, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:52.843682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c112ec-bf9d-4009-b1dc-af512d56ddcf admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:52.862292 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1254/2535] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:33:52 2022] PUT /identity/v3/projects/317b8a7454204073926be40258dccfa2/users/70d925c80e6d4ef2a7dd479c1e2b93cb/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:52.869847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26072669-4002-4c9a-b291-8d23920f49a2 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:52.870177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26072669-4002-4c9a-b291-8d23920f49a2 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:52.870494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26072669-4002-4c9a-b291-8d23920f49a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:52.903325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-26072669-4002-4c9a-b291-8d23920f49a2 None None] MFA Rules not processed for user `70d925c80e6d4ef2a7dd479c1e2b93cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:52.904526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-26072669-4002-4c9a-b291-8d23920f49a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:52.973147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1282/2536] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:52.977659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c112ec-bf9d-4009-b1dc-af512d56ddcf admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:53.048171 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c112ec-bf9d-4009-b1dc-af512d56ddcf admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:53.056559 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb9fe7-c760-4d4b-b5f4-7409d5530618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:53.063837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb9fe7-c760-4d4b-b5f4-7409d5530618 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:53.063837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb9fe7-c760-4d4b-b5f4-7409d5530618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:53.063837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb9fe7-c760-4d4b-b5f4-7409d5530618 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:53.063837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb9fe7-c760-4d4b-b5f4-7409d5530618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:53.063837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb9fe7-c760-4d4b-b5f4-7409d5530618 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:53.099352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1255/2537] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:33:52 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:33:53.100092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26072669-4002-4c9a-b291-8d23920f49a2 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:53.111390 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26072669-4002-4c9a-b291-8d23920f49a2 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:53.178119 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd90c8-d664-447c-92f4-4dac4b66c998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:53.179299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd90c8-d664-447c-92f4-4dac4b66c998 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:53.179299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd90c8-d664-447c-92f4-4dac4b66c998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:53.179530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd90c8-d664-447c-92f4-4dac4b66c998 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:53.180096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd90c8-d664-447c-92f4-4dac4b66c998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:53.182720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd90c8-d664-447c-92f4-4dac4b66c998 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:53.208613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1283/2538] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:33:53 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:33:53.212515 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb9fe7-c760-4d4b-b5f4-7409d5530618 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:53.224478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb9fe7-c760-4d4b-b5f4-7409d5530618 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:53.231121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283c19e-753a-487c-b266-dabd368a7ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:53.231837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283c19e-753a-487c-b266-dabd368a7ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:53.232121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283c19e-753a-487c-b266-dabd368a7ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:53.232430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283c19e-753a-487c-b266-dabd368a7ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:53.233437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283c19e-753a-487c-b266-dabd368a7ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:53.234916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283c19e-753a-487c-b266-dabd368a7ae5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:53.245569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1256/2539] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:53.249681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd90c8-d664-447c-92f4-4dac4b66c998 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:53.262640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd90c8-d664-447c-92f4-4dac4b66c998 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:53.268885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbe93c-d732-4cc5-9fa2-2acaac27dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:53.269841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbe93c-d732-4cc5-9fa2-2acaac27dec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:53.270123 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbe93c-d732-4cc5-9fa2-2acaac27dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:53.270426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbe93c-d732-4cc5-9fa2-2acaac27dec7 admin admin] PATH_INFO: `/v3/projects/e50a1d965f9d434aae9d07ba35f0a93c/users/5b7fc79627af4302be0c37f133d45293/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:53.292183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbe93c-d732-4cc5-9fa2-2acaac27dec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50a1d965f9d434aae9d07ba35f0a93c, user_id=5b7fc79627af4302be0c37f133d45293, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:53.294938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbe93c-d732-4cc5-9fa2-2acaac27dec7 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:53.313915 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1284/2540] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:33:53 2022] PUT /identity/v3/projects/e50a1d965f9d434aae9d07ba35f0a93c/users/5b7fc79627af4302be0c37f133d45293/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:33:53.317977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283c19e-753a-487c-b266-dabd368a7ae5 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:53.328692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283c19e-753a-487c-b266-dabd368a7ae5 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:53.389785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48133be-b535-4278-ab08-0c694a43a956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:53.390915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48133be-b535-4278-ab08-0c694a43a956 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:53.391465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48133be-b535-4278-ab08-0c694a43a956 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:53.392149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48133be-b535-4278-ab08-0c694a43a956 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:53.392886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48133be-b535-4278-ab08-0c694a43a956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:53.394730 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48133be-b535-4278-ab08-0c694a43a956 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:53.406347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1257/2541] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:53.411344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbe93c-d732-4cc5-9fa2-2acaac27dec7 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:53.427865 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbe93c-d732-4cc5-9fa2-2acaac27dec7 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:53.433807 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54decfa-b61c-402c-bdf4-b04e710afb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:53.434887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54decfa-b61c-402c-bdf4-b04e710afb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:53.435245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54decfa-b61c-402c-bdf4-b04e710afb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:53.435773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54decfa-b61c-402c-bdf4-b04e710afb44 admin admin] PATH_INFO: `/v3/projects/e50a1d965f9d434aae9d07ba35f0a93c/users/5b7fc79627af4302be0c37f133d45293/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:53.437886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54decfa-b61c-402c-bdf4-b04e710afb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50a1d965f9d434aae9d07ba35f0a93c, user_id=5b7fc79627af4302be0c37f133d45293, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:53.442505 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54decfa-b61c-402c-bdf4-b04e710afb44 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:53.463848 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1285/2542] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:33:53 2022] PUT /identity/v3/projects/e50a1d965f9d434aae9d07ba35f0a93c/users/5b7fc79627af4302be0c37f133d45293/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:53.465980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aeecc-dd58-4d50-bc5d-d4244fd80e2e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:53.466291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aeecc-dd58-4d50-bc5d-d4244fd80e2e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:53.466657 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aeecc-dd58-4d50-bc5d-d4244fd80e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:53.500761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-7d3aeecc-dd58-4d50-bc5d-d4244fd80e2e None None] MFA Rules not processed for user `5b7fc79627af4302be0c37f133d45293`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:53.502033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7d3aeecc-dd58-4d50-bc5d-d4244fd80e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:53.589687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1258/2543] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:53.601869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54decfa-b61c-402c-bdf4-b04e710afb44 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:53.603628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f54decfa-b61c-402c-bdf4-b04e710afb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:53.660843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54decfa-b61c-402c-bdf4-b04e710afb44 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:53.666496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851f35a-92b1-42ef-96e3-0f6eeb7446bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:53.666496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851f35a-92b1-42ef-96e3-0f6eeb7446bb service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:53.666496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851f35a-92b1-42ef-96e3-0f6eeb7446bb service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:53.666496 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851f35a-92b1-42ef-96e3-0f6eeb7446bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:53.676229 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851f35a-92b1-42ef-96e3-0f6eeb7446bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:53.677647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851f35a-92b1-42ef-96e3-0f6eeb7446bb service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:53.686823 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1286/2544] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:53 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:53.734126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aeecc-dd58-4d50-bc5d-d4244fd80e2e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:53.735551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7d3aeecc-dd58-4d50-bc5d-d4244fd80e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:53.747163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aeecc-dd58-4d50-bc5d-d4244fd80e2e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:53.750592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e07a8-6f9c-4dae-b251-93f5a9251b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:53.751217 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e07a8-6f9c-4dae-b251-93f5a9251b54 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:53.751493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e07a8-6f9c-4dae-b251-93f5a9251b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:53.751763 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e07a8-6f9c-4dae-b251-93f5a9251b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:53.805566 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e07a8-6f9c-4dae-b251-93f5a9251b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:53.806943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e07a8-6f9c-4dae-b251-93f5a9251b54 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:53.815978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1259/2545] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:57.042856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851f35a-92b1-42ef-96e3-0f6eeb7446bb service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:57.102068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851f35a-92b1-42ef-96e3-0f6eeb7446bb service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:57.106558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:57.107417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:57.107696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:57.107971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] PATH_INFO: `/v3/users/70d925c80e6d4ef2a7dd479c1e2b93cb` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:57.109142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d925c80e6d4ef2a7dd479c1e2b93cb)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:57.111071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:57.157803 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d925c80e6d4ef2a7dd479c1e2b93cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.165080 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d925c80e6d4ef2a7dd479c1e2b93cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.173014 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d925c80e6d4ef2a7dd479c1e2b93cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.174135 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d925c80e6d4ef2a7dd479c1e2b93cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.174782 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d925c80e6d4ef2a7dd479c1e2b93cb'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.192019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1287/2546] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:33:57 2022] DELETE /identity/v3/users/70d925c80e6d4ef2a7dd479c1e2b93cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:57.196590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ae09-a9dd-47c0-a2fc-806fea632da6 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:57.197093 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ae09-a9dd-47c0-a2fc-806fea632da6 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:57.197203 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ae09-a9dd-47c0-a2fc-806fea632da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:57.214319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2e70ae09-a9dd-47c0-a2fc-806fea632da6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:57.215430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2e70ae09-a9dd-47c0-a2fc-806fea632da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:57.271138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1260/2547] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:57.280574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:57.281933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:57.336342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2276ea-6c88-48f0-b630-1c6e88b6507f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:57.339905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5d11d-44ca-4f59-84e3-a05b490d8cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:57.340533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5d11d-44ca-4f59-84e3-a05b490d8cac service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:57.340813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5d11d-44ca-4f59-84e3-a05b490d8cac service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:57.341087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5d11d-44ca-4f59-84e3-a05b490d8cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:57.349756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5d11d-44ca-4f59-84e3-a05b490d8cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:57.351297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5d11d-44ca-4f59-84e3-a05b490d8cac service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:57.360268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1288/2548] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:57.622769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70ae09-a9dd-47c0-a2fc-806fea632da6 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:57.624478 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2e70ae09-a9dd-47c0-a2fc-806fea632da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:57.651827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70ae09-a9dd-47c0-a2fc-806fea632da6 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:57.656626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:57.657659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:57.658018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:57.658465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] PATH_INFO: `/v3/projects/317b8a7454204073926be40258dccfa2` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:57.660367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=317b8a7454204073926be40258dccfa2)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:57.662865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:57.716163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '317b8a7454204073926be40258dccfa2', 'request_id': 'req-37761020-adae-4c91-bcb2-9564510c29e0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.724938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '317b8a7454204073926be40258dccfa2', 'request_id': 'req-37761020-adae-4c91-bcb2-9564510c29e0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.730813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '317b8a7454204073926be40258dccfa2', 'request_id': 'req-37761020-adae-4c91-bcb2-9564510c29e0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.745908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] The token cache is being invalidate because project 317b8a7454204073926be40258dccfa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:33:57.746456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.747254 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.749305 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1261/2549] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:33:57 2022] DELETE /identity/v3/projects/317b8a7454204073926be40258dccfa2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:57.753334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5d11d-44ca-4f59-84e3-a05b490d8cac service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:57.762712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5d11d-44ca-4f59-84e3-a05b490d8cac service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:57.832328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:57.833199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:57.833480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:57.833753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] PATH_INFO: `/v3/users/5b7fc79627af4302be0c37f133d45293` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:57.835697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7fc79627af4302be0c37f133d45293)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:57.838054 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:57.890669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7fc79627af4302be0c37f133d45293'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.898997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7fc79627af4302be0c37f133d45293'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.909573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7fc79627af4302be0c37f133d45293'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.910971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7fc79627af4302be0c37f133d45293'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.911503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ec16f617-de68-4d97-aa44-ecc2c1aea5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7fc79627af4302be0c37f133d45293'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:57.933301 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1289/2550] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:33:57 2022] DELETE /identity/v3/users/5b7fc79627af4302be0c37f133d45293 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:58.209460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:58.213934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:58.243963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37761020-adae-4c91-bcb2-9564510c29e0 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:58.305736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:58.306696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.307242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.307605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] PATH_INFO: `/v3/projects/e50a1d965f9d434aae9d07ba35f0a93c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.309024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50a1d965f9d434aae9d07ba35f0a93c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:58.311787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:58.363876 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50a1d965f9d434aae9d07ba35f0a93c', 'request_id': 'req-6e23fccd-0d04-410d-924d-4cf07300c932'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:58.370274 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50a1d965f9d434aae9d07ba35f0a93c', 'request_id': 'req-6e23fccd-0d04-410d-924d-4cf07300c932'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:58.376140 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50a1d965f9d434aae9d07ba35f0a93c', 'request_id': 'req-6e23fccd-0d04-410d-924d-4cf07300c932'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:58.390816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] The token cache is being invalidate because project e50a1d965f9d434aae9d07ba35f0a93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:33:58.391419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:58.392303 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-6e23fccd-0d04-410d-924d-4cf07300c932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:33:58.394430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1262/2551] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:33:58 2022] DELETE /identity/v3/projects/e50a1d965f9d434aae9d07ba35f0a93c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:58.399442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ec922-92a3-43e5-8dfe-b285e1349369 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.399909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ec922-92a3-43e5-8dfe-b285e1349369 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.400056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ec922-92a3-43e5-8dfe-b285e1349369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.420542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f12ec922-92a3-43e5-8dfe-b285e1349369 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:58.421836 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f12ec922-92a3-43e5-8dfe-b285e1349369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:58.483965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1290/2552] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:33:58.492953 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb802-e135-4c9f-89a4-00f218225447 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.493317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb802-e135-4c9f-89a4-00f218225447 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.493686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb802-e135-4c9f-89a4-00f218225447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.512626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0e2fb802-e135-4c9f-89a4-00f218225447 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:58.513977 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0e2fb802-e135-4c9f-89a4-00f218225447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:58.523898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1263/2553] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:58.528243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ec922-92a3-43e5-8dfe-b285e1349369 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:58.538367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ec922-92a3-43e5-8dfe-b285e1349369 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:58.543015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83e34e-e0f6-4ace-b6cb-ee6fe5d79483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:58.543701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83e34e-e0f6-4ace-b6cb-ee6fe5d79483 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.543984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83e34e-e0f6-4ace-b6cb-ee6fe5d79483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.544255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83e34e-e0f6-4ace-b6cb-ee6fe5d79483 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.545009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83e34e-e0f6-4ace-b6cb-ee6fe5d79483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:33:58.545338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83e34e-e0f6-4ace-b6cb-ee6fe5d79483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:58.546965 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83e34e-e0f6-4ace-b6cb-ee6fe5d79483 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:58.559269 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1291/2554] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:33:58.563464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb802-e135-4c9f-89a4-00f218225447 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:58.573582 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb802-e135-4c9f-89a4-00f218225447 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:58.578342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235157-43d8-454f-a1f7-df0e324890a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:58.578995 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235157-43d8-454f-a1f7-df0e324890a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.579275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235157-43d8-454f-a1f7-df0e324890a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.579549 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28235157-43d8-454f-a1f7-df0e324890a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.580267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28235157-43d8-454f-a1f7-df0e324890a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:58.582233 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28235157-43d8-454f-a1f7-df0e324890a8 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:58.610801 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1264/2555] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:33:58 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:33:58.615457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83e34e-e0f6-4ace-b6cb-ee6fe5d79483 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:58.625567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83e34e-e0f6-4ace-b6cb-ee6fe5d79483 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:58.699208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53182afe-41fc-4158-99d8-323a0d8a6774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:58.699901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53182afe-41fc-4158-99d8-323a0d8a6774 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.700183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53182afe-41fc-4158-99d8-323a0d8a6774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.700458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53182afe-41fc-4158-99d8-323a0d8a6774 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.701147 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53182afe-41fc-4158-99d8-323a0d8a6774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:58.703073 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53182afe-41fc-4158-99d8-323a0d8a6774 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:58.732641 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1292/2556] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:33:58 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:33:58.736734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235157-43d8-454f-a1f7-df0e324890a8 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:58.747100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28235157-43d8-454f-a1f7-df0e324890a8 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:58.751915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3d65-459c-4744-ba57-749c57b546ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:58.753138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3d65-459c-4744-ba57-749c57b546ec admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.753441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3d65-459c-4744-ba57-749c57b546ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.753754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3d65-459c-4744-ba57-749c57b546ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.754561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c3d65-459c-4744-ba57-749c57b546ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:58.756200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c3d65-459c-4744-ba57-749c57b546ec admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:58.767131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1265/2557] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:58.771206 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53182afe-41fc-4158-99d8-323a0d8a6774 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:58.783084 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53182afe-41fc-4158-99d8-323a0d8a6774 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:58.789311 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4784a-b6f7-43f8-86ef-5a189d77ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:58.790092 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4784a-b6f7-43f8-86ef-5a189d77ac67 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.790634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4784a-b6f7-43f8-86ef-5a189d77ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.791019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4784a-b6f7-43f8-86ef-5a189d77ac67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.791861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4784a-b6f7-43f8-86ef-5a189d77ac67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:58.793574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4784a-b6f7-43f8-86ef-5a189d77ac67 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:58.805890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1293/2558] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:33:58.809776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3d65-459c-4744-ba57-749c57b546ec admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:58.820985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3d65-459c-4744-ba57-749c57b546ec admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:58.826082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43795443-fc05-44e9-a8e6-6cfe2ec391f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:58.827098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43795443-fc05-44e9-a8e6-6cfe2ec391f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.827468 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43795443-fc05-44e9-a8e6-6cfe2ec391f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.827894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43795443-fc05-44e9-a8e6-6cfe2ec391f1 admin admin] PATH_INFO: `/v3/projects/0ca222ceaf01422c8f860e4b2bec7801/users/af7206b767a14de1b21f117b04cbc99a/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.842915 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43795443-fc05-44e9-a8e6-6cfe2ec391f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca222ceaf01422c8f860e4b2bec7801, user_id=af7206b767a14de1b21f117b04cbc99a, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:58.845617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43795443-fc05-44e9-a8e6-6cfe2ec391f1 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:58.859342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1266/2559] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:33:58 2022] PUT /identity/v3/projects/0ca222ceaf01422c8f860e4b2bec7801/users/af7206b767a14de1b21f117b04cbc99a/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:33:58.870236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa9d3-f694-49ae-a6c2-1b92589149fa None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:58.870578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa9d3-f694-49ae-a6c2-1b92589149fa None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:58.870904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fa9d3-f694-49ae-a6c2-1b92589149fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:58.896797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-714fa9d3-f694-49ae-a6c2-1b92589149fa None None] MFA Rules not processed for user `af7206b767a14de1b21f117b04cbc99a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:33:58.898065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-714fa9d3-f694-49ae-a6c2-1b92589149fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:58.962927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1294/2560] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:33:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:33:58.974120 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43795443-fc05-44e9-a8e6-6cfe2ec391f1 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:58.975856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-43795443-fc05-44e9-a8e6-6cfe2ec391f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:59.101567 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43795443-fc05-44e9-a8e6-6cfe2ec391f1 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:59.106294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31b6b2-8ca5-438b-b81f-81a8be01eb38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:59.106893 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31b6b2-8ca5-438b-b81f-81a8be01eb38 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:59.107235 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31b6b2-8ca5-438b-b81f-81a8be01eb38 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:59.107617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31b6b2-8ca5-438b-b81f-81a8be01eb38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:59.120163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31b6b2-8ca5-438b-b81f-81a8be01eb38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:59.121827 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31b6b2-8ca5-438b-b81f-81a8be01eb38 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:59.136517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1267/2561] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:33:59.821408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fa9d3-f694-49ae-a6c2-1b92589149fa None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:33:59.822894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-714fa9d3-f694-49ae-a6c2-1b92589149fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:59.908595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fa9d3-f694-49ae-a6c2-1b92589149fa None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:33:59.914153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa97729-cf74-4b51-8cab-38ca02936134 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92588782f32a472193340aba2bff8d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:33:59.915379 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97729-cf74-4b51-8cab-38ca02936134 service placement] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:33:59.915809 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97729-cf74-4b51-8cab-38ca02936134 service placement] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:33:59.916153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa97729-cf74-4b51-8cab-38ca02936134 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:33:59.919514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1aa97729-cf74-4b51-8cab-38ca02936134 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:33:59.935037 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa97729-cf74-4b51-8cab-38ca02936134 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:33:59.936692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa97729-cf74-4b51-8cab-38ca02936134 service placement] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:33:59.948237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1295/2562] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:33:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:34:00.578328 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07db78-5cd6-4043-a7c4-9a271fd35283 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:00.578832 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07db78-5cd6-4043-a7c4-9a271fd35283 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:00.578932 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07db78-5cd6-4043-a7c4-9a271fd35283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:00.596890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-6b07db78-5cd6-4043-a7c4-9a271fd35283 None None] MFA Rules not processed for user `3b1d212dad5347a888832a779beadece`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:00.598066 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-6b07db78-5cd6-4043-a7c4-9a271fd35283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:00.657830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1268/2563] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:08.652107 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa97729-cf74-4b51-8cab-38ca02936134 service placement] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:08.713714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa97729-cf74-4b51-8cab-38ca02936134 service placement] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:08.718301 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:08.719347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:08.719636 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:08.719914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] PATH_INFO: `/v3/users/af7206b767a14de1b21f117b04cbc99a` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:08.721160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7206b767a14de1b21f117b04cbc99a)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:08.723096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:08.769320 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7206b767a14de1b21f117b04cbc99a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:08.776101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7206b767a14de1b21f117b04cbc99a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:08.783934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7206b767a14de1b21f117b04cbc99a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:08.784657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7206b767a14de1b21f117b04cbc99a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:08.785399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7206b767a14de1b21f117b04cbc99a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:08.802746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1296/2564] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:34:08 2022] DELETE /identity/v3/users/af7206b767a14de1b21f117b04cbc99a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:34:08.807154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad04ab0-3a31-4251-af1d-d9d163173b7a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:08.807646 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad04ab0-3a31-4251-af1d-d9d163173b7a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:08.807752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad04ab0-3a31-4251-af1d-d9d163173b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:08.825107 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-fad04ab0-3a31-4251-af1d-d9d163173b7a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:08.826296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fad04ab0-3a31-4251-af1d-d9d163173b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:08.881773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1269/2565] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:08.891338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:08.892720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:08.946492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e4487-bad5-455c-838f-c3a7f7c42e8e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:08.950046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a778460-7639-45c0-9239-9e22991570cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:08.950707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778460-7639-45c0-9239-9e22991570cb service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:08.950988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778460-7639-45c0-9239-9e22991570cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:08.951257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a778460-7639-45c0-9239-9e22991570cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:08.959890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a778460-7639-45c0-9239-9e22991570cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:08.961287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a778460-7639-45c0-9239-9e22991570cb service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:08.970280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1297/2566] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:34:09.230194 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad04ab0-3a31-4251-af1d-d9d163173b7a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:09.231732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-fad04ab0-3a31-4251-af1d-d9d163173b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:09.245707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad04ab0-3a31-4251-af1d-d9d163173b7a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:09.250917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:09.251796 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.252091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.252365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] PATH_INFO: `/v3/projects/0ca222ceaf01422c8f860e4b2bec7801` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.254122 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca222ceaf01422c8f860e4b2bec7801)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:09.256668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:09.304506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca222ceaf01422c8f860e4b2bec7801', 'request_id': 'req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:09.310717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca222ceaf01422c8f860e4b2bec7801', 'request_id': 'req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:09.316236 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca222ceaf01422c8f860e4b2bec7801', 'request_id': 'req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:09.327945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] The token cache is being invalidate because project 0ca222ceaf01422c8f860e4b2bec7801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:34:09.328278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:09.328904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-f7a7224d-4af0-4ad3-9cf1-d8df64a0c1d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:09.330640 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1270/2567] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:34:09 2022] DELETE /identity/v3/projects/0ca222ceaf01422c8f860e4b2bec7801 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:34:09.335440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea19fe5-0118-4fda-98d8-9f30b556771d None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.335880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea19fe5-0118-4fda-98d8-9f30b556771d None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.336272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea19fe5-0118-4fda-98d8-9f30b556771d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.355403 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4ea19fe5-0118-4fda-98d8-9f30b556771d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:09.357473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4ea19fe5-0118-4fda-98d8-9f30b556771d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:09.422540 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1298/2568] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:09.432703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f63ef-dd3e-4231-ae4e-fa72b55bf398 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.434091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f63ef-dd3e-4231-ae4e-fa72b55bf398 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.434583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f63ef-dd3e-4231-ae4e-fa72b55bf398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.456085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-df9f63ef-dd3e-4231-ae4e-fa72b55bf398 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:09.457329 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-df9f63ef-dd3e-4231-ae4e-fa72b55bf398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:09.466498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1271/2569] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:09.469889 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea19fe5-0118-4fda-98d8-9f30b556771d None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:09.480333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea19fe5-0118-4fda-98d8-9f30b556771d None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:09.485027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce9f60-d2c3-4049-b2c7-4c75d0d42f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:09.485692 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9f60-d2c3-4049-b2c7-4c75d0d42f03 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.485981 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9f60-d2c3-4049-b2c7-4c75d0d42f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.486350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce9f60-d2c3-4049-b2c7-4c75d0d42f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.487759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce9f60-d2c3-4049-b2c7-4c75d0d42f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:34:09.488075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce9f60-d2c3-4049-b2c7-4c75d0d42f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:09.489653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce9f60-d2c3-4049-b2c7-4c75d0d42f03 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:09.501654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1299/2570] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:34:09.506102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f63ef-dd3e-4231-ae4e-fa72b55bf398 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:09.516293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f63ef-dd3e-4231-ae4e-fa72b55bf398 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:09.522184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0d1e1-b70e-4724-91be-88ded2b93798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:09.522911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0d1e1-b70e-4724-91be-88ded2b93798 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.523186 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0d1e1-b70e-4724-91be-88ded2b93798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.523464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0d1e1-b70e-4724-91be-88ded2b93798 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.524163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0d1e1-b70e-4724-91be-88ded2b93798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:09.526085 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0d1e1-b70e-4724-91be-88ded2b93798 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:09.558291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1272/2571] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:34:09 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:34:09.559859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce9f60-d2c3-4049-b2c7-4c75d0d42f03 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:09.570000 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce9f60-d2c3-4049-b2c7-4c75d0d42f03 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:09.627486 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b760272-a853-4b3e-bbb6-6a1107e3da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:09.628318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b760272-a853-4b3e-bbb6-6a1107e3da24 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.628667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b760272-a853-4b3e-bbb6-6a1107e3da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.629044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b760272-a853-4b3e-bbb6-6a1107e3da24 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.629811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b760272-a853-4b3e-bbb6-6a1107e3da24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:09.631932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b760272-a853-4b3e-bbb6-6a1107e3da24 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:09.657802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0d1e1-b70e-4724-91be-88ded2b93798 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:09.659211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1300/2572] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:34:09 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:34:09.669943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0d1e1-b70e-4724-91be-88ded2b93798 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:09.674614 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21961b0c-0f16-4735-8d5c-2da3fb696b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:09.675218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21961b0c-0f16-4735-8d5c-2da3fb696b46 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.675496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21961b0c-0f16-4735-8d5c-2da3fb696b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.675765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21961b0c-0f16-4735-8d5c-2da3fb696b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.676511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21961b0c-0f16-4735-8d5c-2da3fb696b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:09.678078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21961b0c-0f16-4735-8d5c-2da3fb696b46 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:09.688476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1273/2573] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:34:09.692660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b760272-a853-4b3e-bbb6-6a1107e3da24 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:09.702144 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b760272-a853-4b3e-bbb6-6a1107e3da24 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:09.707129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb86a40-1186-43c7-9941-15d819ae89ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:09.707779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb86a40-1186-43c7-9941-15d819ae89ba admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.708058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb86a40-1186-43c7-9941-15d819ae89ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.708329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb86a40-1186-43c7-9941-15d819ae89ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.709048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb86a40-1186-43c7-9941-15d819ae89ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:09.710651 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb86a40-1186-43c7-9941-15d819ae89ba admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:09.720374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1301/2574] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:34:09.724538 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21961b0c-0f16-4735-8d5c-2da3fb696b46 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:09.734012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21961b0c-0f16-4735-8d5c-2da3fb696b46 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:09.739452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53a102-ad4b-409f-9b5c-7088e0fca54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:09.740351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53a102-ad4b-409f-9b5c-7088e0fca54f admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.740631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53a102-ad4b-409f-9b5c-7088e0fca54f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.740971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53a102-ad4b-409f-9b5c-7088e0fca54f admin admin] PATH_INFO: `/v3/projects/d111dc0cb8e14b6881343d6a3c47dc9a/users/1fc4632f350844e4985c432035dab12d/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.757113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53a102-ad4b-409f-9b5c-7088e0fca54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d111dc0cb8e14b6881343d6a3c47dc9a, user_id=1fc4632f350844e4985c432035dab12d, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:09.759870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53a102-ad4b-409f-9b5c-7088e0fca54f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:09.772482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1274/2575] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:34:09 2022] PUT /identity/v3/projects/d111dc0cb8e14b6881343d6a3c47dc9a/users/1fc4632f350844e4985c432035dab12d/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:34:09.782755 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6475-04c7-4f51-a63c-ba21586cc18b None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.783047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6475-04c7-4f51-a63c-ba21586cc18b None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.783328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f6475-04c7-4f51-a63c-ba21586cc18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.809150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b62f6475-04c7-4f51-a63c-ba21586cc18b None None] MFA Rules not processed for user `1fc4632f350844e4985c432035dab12d`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:09.810382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b62f6475-04c7-4f51-a63c-ba21586cc18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:09.870770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1302/2576] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:09.882362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53a102-ad4b-409f-9b5c-7088e0fca54f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:09.884074 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3f53a102-ad4b-409f-9b5c-7088e0fca54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:09.937878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53a102-ad4b-409f-9b5c-7088e0fca54f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:09.942048 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a82df-8e40-405f-8bd5-f1477f143238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:09.942718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a82df-8e40-405f-8bd5-f1477f143238 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:09.942997 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a82df-8e40-405f-8bd5-f1477f143238 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:09.943267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a82df-8e40-405f-8bd5-f1477f143238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:09.951157 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a82df-8e40-405f-8bd5-f1477f143238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:09.952563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a82df-8e40-405f-8bd5-f1477f143238 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:09.960996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1275/2577] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:34:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:34:34.538712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f6475-04c7-4f51-a63c-ba21586cc18b None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:34.597858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f6475-04c7-4f51-a63c-ba21586cc18b None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:34.602324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:34.603300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:34.603583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:34.603856 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] PATH_INFO: `/v3/users/1fc4632f350844e4985c432035dab12d` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:34.605023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc4632f350844e4985c432035dab12d)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:34.606955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:34.650535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc4632f350844e4985c432035dab12d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:34.657081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc4632f350844e4985c432035dab12d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:34.663818 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc4632f350844e4985c432035dab12d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:34.664499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc4632f350844e4985c432035dab12d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:34.665117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc4632f350844e4985c432035dab12d'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:34.681778 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1303/2578] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:34:34 2022] DELETE /identity/v3/users/1fc4632f350844e4985c432035dab12d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:34:34.686286 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61b04-978e-477d-9f50-e97798278876 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:34.686773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61b04-978e-477d-9f50-e97798278876 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:34.686883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc61b04-978e-477d-9f50-e97798278876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:34.703541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-3fc61b04-978e-477d-9f50-e97798278876 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:34.704764 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3fc61b04-978e-477d-9f50-e97798278876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:34.760108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1276/2579] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:34:34.770399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:34.771774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:34.827026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bc334-b567-4b67-be89-9bff776d3b97 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:34.830621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cbb8a-b153-4fca-94db-f78c0ca41c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:34.831260 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cbb8a-b153-4fca-94db-f78c0ca41c90 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:34.831536 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cbb8a-b153-4fca-94db-f78c0ca41c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:34.831812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cbb8a-b153-4fca-94db-f78c0ca41c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:34.840688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cbb8a-b153-4fca-94db-f78c0ca41c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:34.842096 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cbb8a-b153-4fca-94db-f78c0ca41c90 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:34.852155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1304/2580] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:34:35.143806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc61b04-978e-477d-9f50-e97798278876 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:35.145221 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3fc61b04-978e-477d-9f50-e97798278876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:35.156666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc61b04-978e-477d-9f50-e97798278876 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:35.161954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:35.162864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.163146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.163422 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] PATH_INFO: `/v3/projects/d111dc0cb8e14b6881343d6a3c47dc9a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.164606 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d111dc0cb8e14b6881343d6a3c47dc9a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:35.166585 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:35.211433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd111dc0cb8e14b6881343d6a3c47dc9a', 'request_id': 'req-98968de9-2535-42e8-bf9e-a3ca8479a4a0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:35.217314 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd111dc0cb8e14b6881343d6a3c47dc9a', 'request_id': 'req-98968de9-2535-42e8-bf9e-a3ca8479a4a0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:35.222660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd111dc0cb8e14b6881343d6a3c47dc9a', 'request_id': 'req-98968de9-2535-42e8-bf9e-a3ca8479a4a0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:35.234087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] The token cache is being invalidate because project d111dc0cb8e14b6881343d6a3c47dc9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:34:35.234417 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:35.235040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-98968de9-2535-42e8-bf9e-a3ca8479a4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:35.237112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1277/2581] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:34:35 2022] DELETE /identity/v3/projects/d111dc0cb8e14b6881343d6a3c47dc9a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:34:35.242145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99a6ef-19a9-46db-a62b-d987531015c5 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.242480 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99a6ef-19a9-46db-a62b-d987531015c5 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.242760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c99a6ef-19a9-46db-a62b-d987531015c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.260210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-9c99a6ef-19a9-46db-a62b-d987531015c5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:35.261384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9c99a6ef-19a9-46db-a62b-d987531015c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:35.318101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1305/2582] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:35.326919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de290-c37b-4a06-a161-7a14bb4fda74 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.327212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de290-c37b-4a06-a161-7a14bb4fda74 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.327496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de290-c37b-4a06-a161-7a14bb4fda74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.345281 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0b2de290-c37b-4a06-a161-7a14bb4fda74 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:35.346530 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0b2de290-c37b-4a06-a161-7a14bb4fda74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:35.354564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1278/2583] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:35.358729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99a6ef-19a9-46db-a62b-d987531015c5 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:35.368358 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c99a6ef-19a9-46db-a62b-d987531015c5 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:35.372825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af30be-73c0-481c-88c1-798b25977825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:35.373460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af30be-73c0-481c-88c1-798b25977825 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.373739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af30be-73c0-481c-88c1-798b25977825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.374006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af30be-73c0-481c-88c1-798b25977825 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.374750 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af30be-73c0-481c-88c1-798b25977825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:34:35.375050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af30be-73c0-481c-88c1-798b25977825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:35.377227 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af30be-73c0-481c-88c1-798b25977825 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:35.387959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1306/2584] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:34:35.392362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de290-c37b-4a06-a161-7a14bb4fda74 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:35.401099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de290-c37b-4a06-a161-7a14bb4fda74 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:35.405637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5da76-546f-4b0d-90d5-9110d36e1279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:35.406296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5da76-546f-4b0d-90d5-9110d36e1279 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.406579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5da76-546f-4b0d-90d5-9110d36e1279 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.406851 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5da76-546f-4b0d-90d5-9110d36e1279 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.407532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5da76-546f-4b0d-90d5-9110d36e1279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:35.409513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5da76-546f-4b0d-90d5-9110d36e1279 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:35.434737 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1279/2585] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:34:35 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:34:35.438824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af30be-73c0-481c-88c1-798b25977825 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:35.449016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af30be-73c0-481c-88c1-798b25977825 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:35.501998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c37aed-77e1-4a42-bc87-2e12c7a4633c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:35.502679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c37aed-77e1-4a42-bc87-2e12c7a4633c admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.502962 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c37aed-77e1-4a42-bc87-2e12c7a4633c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.503228 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c37aed-77e1-4a42-bc87-2e12c7a4633c admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.503900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c37aed-77e1-4a42-bc87-2e12c7a4633c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:35.505756 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c37aed-77e1-4a42-bc87-2e12c7a4633c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:35.525077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1307/2586] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:34:35 2022] POST /identity/v3/users => generated 292 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:34:35.529149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5da76-546f-4b0d-90d5-9110d36e1279 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:35.539175 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5da76-546f-4b0d-90d5-9110d36e1279 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:35.543886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ce3dd-13d5-4011-a0ea-62cbf90e2c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:35.544550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce3dd-13d5-4011-a0ea-62cbf90e2c9a admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.544822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce3dd-13d5-4011-a0ea-62cbf90e2c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.545095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ce3dd-13d5-4011-a0ea-62cbf90e2c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.545815 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce3dd-13d5-4011-a0ea-62cbf90e2c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:35.547412 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ce3dd-13d5-4011-a0ea-62cbf90e2c9a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:35.557769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1280/2587] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:34:35.561813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c37aed-77e1-4a42-bc87-2e12c7a4633c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:35.572443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c37aed-77e1-4a42-bc87-2e12c7a4633c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:35.577310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a60a3-c4ac-4f59-90a1-388cde4f97b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:35.577999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a60a3-c4ac-4f59-90a1-388cde4f97b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.578343 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a60a3-c4ac-4f59-90a1-388cde4f97b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.578623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a60a3-c4ac-4f59-90a1-388cde4f97b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.580003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a60a3-c4ac-4f59-90a1-388cde4f97b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:35.581632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a60a3-c4ac-4f59-90a1-388cde4f97b6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:35.591765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1308/2588] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:34:35.595662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ce3dd-13d5-4011-a0ea-62cbf90e2c9a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:35.605326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ce3dd-13d5-4011-a0ea-62cbf90e2c9a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:35.609836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a6a95-74af-43ed-93db-98055ff3bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:35.610761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a6a95-74af-43ed-93db-98055ff3bafd admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.611029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a6a95-74af-43ed-93db-98055ff3bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.611306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a6a95-74af-43ed-93db-98055ff3bafd admin admin] PATH_INFO: `/v3/projects/af49bc5af86c4843a84e5fc70b3309ba/users/ac21a97333d7464aa22d42cdad52c1e3/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.624985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a6a95-74af-43ed-93db-98055ff3bafd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af49bc5af86c4843a84e5fc70b3309ba, user_id=ac21a97333d7464aa22d42cdad52c1e3, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:35.628135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a6a95-74af-43ed-93db-98055ff3bafd admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:35.640838 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1281/2589] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:34:35 2022] PUT /identity/v3/projects/af49bc5af86c4843a84e5fc70b3309ba/users/ac21a97333d7464aa22d42cdad52c1e3/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:34:35.651861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe0ca-206c-4b1c-9f55-77f54931415f None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.652149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe0ca-206c-4b1c-9f55-77f54931415f None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.652425 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fe0ca-206c-4b1c-9f55-77f54931415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.679208 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-631fe0ca-206c-4b1c-9f55-77f54931415f None None] MFA Rules not processed for user `ac21a97333d7464aa22d42cdad52c1e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:35.680430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-631fe0ca-206c-4b1c-9f55-77f54931415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:35.740160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1309/2590] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:35.751745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a6a95-74af-43ed-93db-98055ff3bafd admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:35.753460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-745a6a95-74af-43ed-93db-98055ff3bafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:35.807368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a6a95-74af-43ed-93db-98055ff3bafd admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:35.810956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599eca77-42ca-418e-b820-4525d314fc5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:35.811586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599eca77-42ca-418e-b820-4525d314fc5a service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:35.811867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599eca77-42ca-418e-b820-4525d314fc5a service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:35.812142 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599eca77-42ca-418e-b820-4525d314fc5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:35.820687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599eca77-42ca-418e-b820-4525d314fc5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:35.822098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599eca77-42ca-418e-b820-4525d314fc5a service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:35.831248 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1282/2591] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:34:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:34:38.358452 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe0ca-206c-4b1c-9f55-77f54931415f None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:38.418266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631fe0ca-206c-4b1c-9f55-77f54931415f None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:38.423017 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:38.423890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:38.424168 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:38.424433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] PATH_INFO: `/v3/users/ac21a97333d7464aa22d42cdad52c1e3` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:38.425612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac21a97333d7464aa22d42cdad52c1e3)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:38.427533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:38.472490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac21a97333d7464aa22d42cdad52c1e3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:38.479181 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac21a97333d7464aa22d42cdad52c1e3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:38.486041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac21a97333d7464aa22d42cdad52c1e3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:38.486671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac21a97333d7464aa22d42cdad52c1e3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:38.487264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac21a97333d7464aa22d42cdad52c1e3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:38.503790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1310/2592] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:34:38 2022] DELETE /identity/v3/users/ac21a97333d7464aa22d42cdad52c1e3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:34:38.508331 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45afb-93ad-45e8-a1e4-b926535071f0 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:38.508816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45afb-93ad-45e8-a1e4-b926535071f0 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:38.508937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45afb-93ad-45e8-a1e4-b926535071f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:38.526067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-bef45afb-93ad-45e8-a1e4-b926535071f0 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:38.527307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bef45afb-93ad-45e8-a1e4-b926535071f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:38.581898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1283/2593] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:38.591300 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:38.592672 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:38.648560 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72387c0c-ac0b-4e8b-8c96-76e11dd7cb62 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:38.652879 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbadb75-09c7-4f18-9d3f-b326de41807c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:38.653548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbadb75-09c7-4f18-9d3f-b326de41807c service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:38.653833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbadb75-09c7-4f18-9d3f-b326de41807c service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:38.654106 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbadb75-09c7-4f18-9d3f-b326de41807c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:38.669931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbadb75-09c7-4f18-9d3f-b326de41807c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:38.671423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbadb75-09c7-4f18-9d3f-b326de41807c service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:38.680861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1311/2594] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:34:38.938543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef45afb-93ad-45e8-a1e4-b926535071f0 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:38.940692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bef45afb-93ad-45e8-a1e4-b926535071f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:38.952738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef45afb-93ad-45e8-a1e4-b926535071f0 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:38.957364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:38.958231 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:38.958542 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:38.958816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] PATH_INFO: `/v3/projects/af49bc5af86c4843a84e5fc70b3309ba` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:38.960106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af49bc5af86c4843a84e5fc70b3309ba)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:38.962126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:39.008106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af49bc5af86c4843a84e5fc70b3309ba', 'request_id': 'req-e86c2201-05d7-4034-8e79-78a1138591a8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:39.014033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af49bc5af86c4843a84e5fc70b3309ba', 'request_id': 'req-e86c2201-05d7-4034-8e79-78a1138591a8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:39.019607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af49bc5af86c4843a84e5fc70b3309ba', 'request_id': 'req-e86c2201-05d7-4034-8e79-78a1138591a8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:39.031057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] The token cache is being invalidate because project af49bc5af86c4843a84e5fc70b3309ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:34:39.031333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:39.031934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e86c2201-05d7-4034-8e79-78a1138591a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:34:39.033435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1284/2595] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:34:38 2022] DELETE /identity/v3/projects/af49bc5af86c4843a84e5fc70b3309ba => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:34:39.038376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6603ba2-2de8-4fa0-b80d-fc77eca0f0d7 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.038668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6603ba2-2de8-4fa0-b80d-fc77eca0f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.038943 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6603ba2-2de8-4fa0-b80d-fc77eca0f0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.056138 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b6603ba2-2de8-4fa0-b80d-fc77eca0f0d7 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:39.057310 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b6603ba2-2de8-4fa0-b80d-fc77eca0f0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:39.113079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1312/2596] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:39.120828 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f43697-4a43-4eec-a109-dc7e88610bb4 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.121058 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f43697-4a43-4eec-a109-dc7e88610bb4 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.121335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f43697-4a43-4eec-a109-dc7e88610bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.139432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e1f43697-4a43-4eec-a109-dc7e88610bb4 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:39.140879 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e1f43697-4a43-4eec-a109-dc7e88610bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:39.148641 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1285/2597] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:39.152634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6603ba2-2de8-4fa0-b80d-fc77eca0f0d7 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:39.162036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6603ba2-2de8-4fa0-b80d-fc77eca0f0d7 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:39.166810 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854828f-3553-491c-a141-872b2cccc8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:39.167451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854828f-3553-491c-a141-872b2cccc8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.167730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854828f-3553-491c-a141-872b2cccc8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.168002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854828f-3553-491c-a141-872b2cccc8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.168714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854828f-3553-491c-a141-872b2cccc8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:34:39.169016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854828f-3553-491c-a141-872b2cccc8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:39.170613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854828f-3553-491c-a141-872b2cccc8b8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:39.182985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1313/2598] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:34:39.187129 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f43697-4a43-4eec-a109-dc7e88610bb4 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:39.196633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f43697-4a43-4eec-a109-dc7e88610bb4 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:39.201193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944c3c-eedb-4ebe-881a-43fd796b93b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:39.201833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944c3c-eedb-4ebe-881a-43fd796b93b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.202116 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944c3c-eedb-4ebe-881a-43fd796b93b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.202429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df944c3c-eedb-4ebe-881a-43fd796b93b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.203118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df944c3c-eedb-4ebe-881a-43fd796b93b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:39.205065 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df944c3c-eedb-4ebe-881a-43fd796b93b3 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:39.229601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1286/2599] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:34:39 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:34:39.233882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854828f-3553-491c-a141-872b2cccc8b8 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:39.244071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854828f-3553-491c-a141-872b2cccc8b8 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:39.298433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1fbf-f309-4b49-8b6b-ca27d0873caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:39.299126 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1fbf-f309-4b49-8b6b-ca27d0873caa admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.299415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1fbf-f309-4b49-8b6b-ca27d0873caa admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.299696 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1fbf-f309-4b49-8b6b-ca27d0873caa admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.300369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c1fbf-f309-4b49-8b6b-ca27d0873caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:39.302289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c1fbf-f309-4b49-8b6b-ca27d0873caa admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:39.321229 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1314/2600] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:34:39 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:34:39.325285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944c3c-eedb-4ebe-881a-43fd796b93b3 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:39.335788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df944c3c-eedb-4ebe-881a-43fd796b93b3 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:39.340431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770e519-6b52-4491-9833-ac5ab2525d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:39.341083 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770e519-6b52-4491-9833-ac5ab2525d98 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.341367 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770e519-6b52-4491-9833-ac5ab2525d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.341645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770e519-6b52-4491-9833-ac5ab2525d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.342406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770e519-6b52-4491-9833-ac5ab2525d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:39.344069 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770e519-6b52-4491-9833-ac5ab2525d98 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:39.355910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1287/2601] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:34:39.359796 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1fbf-f309-4b49-8b6b-ca27d0873caa admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:39.369860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1fbf-f309-4b49-8b6b-ca27d0873caa admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:39.374498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c57ff-dda2-4402-82e1-a43c38df6352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:39.375095 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c57ff-dda2-4402-82e1-a43c38df6352 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.375380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c57ff-dda2-4402-82e1-a43c38df6352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.375664 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c57ff-dda2-4402-82e1-a43c38df6352 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.376968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c57ff-dda2-4402-82e1-a43c38df6352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:39.378638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c57ff-dda2-4402-82e1-a43c38df6352 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:39.388034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1315/2602] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:34:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:34:39.392745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770e519-6b52-4491-9833-ac5ab2525d98 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:39.402193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770e519-6b52-4491-9833-ac5ab2525d98 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:39.406758 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51393f2-e79b-4f8a-83f4-250863eec77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:39.407649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51393f2-e79b-4f8a-83f4-250863eec77c admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.407925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51393f2-e79b-4f8a-83f4-250863eec77c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.408196 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51393f2-e79b-4f8a-83f4-250863eec77c admin admin] PATH_INFO: `/v3/projects/323743848f174ae7a70cc2d0952db4e1/users/713cc5554a6b4fa2a68d66006f907f4c/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.423218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51393f2-e79b-4f8a-83f4-250863eec77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=323743848f174ae7a70cc2d0952db4e1, user_id=713cc5554a6b4fa2a68d66006f907f4c, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:39.425875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51393f2-e79b-4f8a-83f4-250863eec77c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:39.440603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1288/2603] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:34:39 2022] PUT /identity/v3/projects/323743848f174ae7a70cc2d0952db4e1/users/713cc5554a6b4fa2a68d66006f907f4c/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:34:39.451743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69681d-07a7-4208-90fe-f5fcbceec808 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.452043 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69681d-07a7-4208-90fe-f5fcbceec808 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.452356 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69681d-07a7-4208-90fe-f5fcbceec808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.482869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-5f69681d-07a7-4208-90fe-f5fcbceec808 None None] MFA Rules not processed for user `713cc5554a6b4fa2a68d66006f907f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:39.484159 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5f69681d-07a7-4208-90fe-f5fcbceec808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:39.550645 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1316/2604] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:39.561463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51393f2-e79b-4f8a-83f4-250863eec77c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:39.563166 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e51393f2-e79b-4f8a-83f4-250863eec77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:39.620709 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51393f2-e79b-4f8a-83f4-250863eec77c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:39.624452 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863fdb6-14c4-453d-a714-62efb2118540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:39.625148 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863fdb6-14c4-453d-a714-62efb2118540 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:39.625377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863fdb6-14c4-453d-a714-62efb2118540 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:39.625699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863fdb6-14c4-453d-a714-62efb2118540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:39.634100 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863fdb6-14c4-453d-a714-62efb2118540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:39.635636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863fdb6-14c4-453d-a714-62efb2118540 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:39.645311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1289/2605] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:34:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:34:40.981475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862fa1c-fe2c-4b07-bc28-0457b4f84712 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:40.981960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862fa1c-fe2c-4b07-bc28-0457b4f84712 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:40.982058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862fa1c-fe2c-4b07-bc28-0457b4f84712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:40.999103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3862fa1c-fe2c-4b07-bc28-0457b4f84712 None None] MFA Rules not processed for user `713cc5554a6b4fa2a68d66006f907f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:41.000276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3862fa1c-fe2c-4b07-bc28-0457b4f84712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:41.007668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1317/2606] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:34:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:48.214551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2a6e4-2d96-4259-a007-15bd35797f08 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:48.215086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2a6e4-2d96-4259-a007-15bd35797f08 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:48.215183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2a6e4-2d96-4259-a007-15bd35797f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:48.233414 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-12b2a6e4-2d96-4259-a007-15bd35797f08 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:48.234890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-12b2a6e4-2d96-4259-a007-15bd35797f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:48.291517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1290/2607] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:34:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:48.340820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862fa1c-fe2c-4b07-bc28-0457b4f84712 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:48.342393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3862fa1c-fe2c-4b07-bc28-0457b4f84712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:48.411521 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862fa1c-fe2c-4b07-bc28-0457b4f84712 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:48.416459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980d333-ccd3-47a4-8730-0dccba19f158 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:48.417122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980d333-ccd3-47a4-8730-0dccba19f158 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:48.417399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980d333-ccd3-47a4-8730-0dccba19f158 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:48.417667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980d333-ccd3-47a4-8730-0dccba19f158 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:48.425695 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980d333-ccd3-47a4-8730-0dccba19f158 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:48.427373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980d333-ccd3-47a4-8730-0dccba19f158 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:48.435900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1318/2608] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:34:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:34:58.701789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0ee4-a800-4811-829a-2d745e5c109c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:58.702438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0ee4-a800-4811-829a-2d745e5c109c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:58.702438 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de0ee4-a800-4811-829a-2d745e5c109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:58.720918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b4de0ee4-a800-4811-829a-2d745e5c109c None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:58.722111 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b4de0ee4-a800-4811-829a-2d745e5c109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:58.729245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1291/2609] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:34:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:58.741546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980d333-ccd3-47a4-8730-0dccba19f158 service swift] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:58.751798 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980d333-ccd3-47a4-8730-0dccba19f158 service swift] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:58.756851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3b5de-51d7-4770-ba52-600fdebec0b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:58.757423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3b5de-51d7-4770-ba52-600fdebec0b3 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:58.757710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3b5de-51d7-4770-ba52-600fdebec0b3 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:58.757990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3b5de-51d7-4770-ba52-600fdebec0b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:58.766020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3b5de-51d7-4770-ba52-600fdebec0b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:58.768152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3b5de-51d7-4770-ba52-600fdebec0b3 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:58.775933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1319/2610] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:34:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:34:59.277213 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76a51-80c1-42a2-ad6d-c0c6f083d775 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:59.277502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76a51-80c1-42a2-ad6d-c0c6f083d775 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:59.277780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76a51-80c1-42a2-ad6d-c0c6f083d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:59.295637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-0df76a51-80c1-42a2-ad6d-c0c6f083d775 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:59.296826 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0df76a51-80c1-42a2-ad6d-c0c6f083d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:59.304718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1292/2611] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 00:34:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:59.317083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3b5de-51d7-4770-ba52-600fdebec0b3 service swift] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:59.327436 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3b5de-51d7-4770-ba52-600fdebec0b3 service swift] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:59.332396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5800521-5047-42d2-9506-9b7c936a9186 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:59.333023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5800521-5047-42d2-9506-9b7c936a9186 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:59.333303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5800521-5047-42d2-9506-9b7c936a9186 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:59.333577 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5800521-5047-42d2-9506-9b7c936a9186 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:59.342421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5800521-5047-42d2-9506-9b7c936a9186 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:59.343974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5800521-5047-42d2-9506-9b7c936a9186 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:59.352510 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1320/2612] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:34:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:34:59.548500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5c67-a920-45b9-922a-7d712a9b0702 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:59.548789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5c67-a920-45b9-922a-7d712a9b0702 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:59.549063 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd5c67-a920-45b9-922a-7d712a9b0702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:59.567772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e1fd5c67-a920-45b9-922a-7d712a9b0702 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:59.569024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e1fd5c67-a920-45b9-922a-7d712a9b0702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:59.576978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1293/2613] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:34:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:59.589380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5800521-5047-42d2-9506-9b7c936a9186 service swift] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:34:59.599576 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5800521-5047-42d2-9506-9b7c936a9186 service swift] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:34:59.604644 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c2621-e7a3-4576-b4d0-16741eaca436 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:34:59.605277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c2621-e7a3-4576-b4d0-16741eaca436 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:59.605557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c2621-e7a3-4576-b4d0-16741eaca436 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:59.605858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c2621-e7a3-4576-b4d0-16741eaca436 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:59.614575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c2621-e7a3-4576-b4d0-16741eaca436 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:34:59.616129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c2621-e7a3-4576-b4d0-16741eaca436 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:34:59.624053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1321/2614] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:34:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:34:59.958586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91428-6499-43d4-849c-06a264de4687 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:34:59.959063 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91428-6499-43d4-849c-06a264de4687 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:34:59.959183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91428-6499-43d4-849c-06a264de4687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:34:59.977872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-dbb91428-6499-43d4-849c-06a264de4687 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:34:59.979098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-dbb91428-6499-43d4-849c-06a264de4687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:34:59.986955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1294/2615] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 00:34:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:34:59.999281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c2621-e7a3-4576-b4d0-16741eaca436 service swift] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:00.009618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c2621-e7a3-4576-b4d0-16741eaca436 service swift] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:00.014748 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae525a-55a7-4f1d-8483-4ebdfaba2077 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:00.015441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae525a-55a7-4f1d-8483-4ebdfaba2077 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:00.015987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae525a-55a7-4f1d-8483-4ebdfaba2077 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:00.016262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae525a-55a7-4f1d-8483-4ebdfaba2077 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:00.024289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae525a-55a7-4f1d-8483-4ebdfaba2077 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:00.025870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae525a-55a7-4f1d-8483-4ebdfaba2077 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:00.034709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1322/2616] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:34:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:35:02.046902 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91428-6499-43d4-849c-06a264de4687 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:02.106897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91428-6499-43d4-849c-06a264de4687 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:02.111323 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:02.112188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:02.112474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:02.112751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] PATH_INFO: `/v3/users/713cc5554a6b4fa2a68d66006f907f4c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:02.113931 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713cc5554a6b4fa2a68d66006f907f4c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:02.115864 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:02.166816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713cc5554a6b4fa2a68d66006f907f4c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.173602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713cc5554a6b4fa2a68d66006f907f4c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.182505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713cc5554a6b4fa2a68d66006f907f4c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.183179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713cc5554a6b4fa2a68d66006f907f4c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.183835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713cc5554a6b4fa2a68d66006f907f4c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.205494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1295/2617] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:35:02 2022] DELETE /identity/v3/users/713cc5554a6b4fa2a68d66006f907f4c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:35:02.210441 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1798ea7-295c-4c00-bc7d-5207f7f356cf None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:02.211481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1798ea7-295c-4c00-bc7d-5207f7f356cf None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:02.211744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1798ea7-295c-4c00-bc7d-5207f7f356cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:02.228908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b1798ea7-295c-4c00-bc7d-5207f7f356cf None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:35:02.230103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b1798ea7-295c-4c00-bc7d-5207f7f356cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:02.290868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1323/2618] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:35:02.301250 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:02.302686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:02.363463 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4d078-e2e7-490a-ac1c-1e57c4381c91 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:02.367532 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42204473-77df-4636-b867-26dcaab6a3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:02.368204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204473-77df-4636-b867-26dcaab6a3ac service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:02.368569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204473-77df-4636-b867-26dcaab6a3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:02.368913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42204473-77df-4636-b867-26dcaab6a3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:02.378809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42204473-77df-4636-b867-26dcaab6a3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:02.380264 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42204473-77df-4636-b867-26dcaab6a3ac service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:02.390079 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1296/2619] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:35:02.569338 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1798ea7-295c-4c00-bc7d-5207f7f356cf None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:02.570829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b1798ea7-295c-4c00-bc7d-5207f7f356cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:02.583035 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1798ea7-295c-4c00-bc7d-5207f7f356cf None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:02.604349 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:02.605216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:02.605740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:02.606277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] PATH_INFO: `/v3/projects/323743848f174ae7a70cc2d0952db4e1` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:02.607573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=323743848f174ae7a70cc2d0952db4e1)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:02.609688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:02.657183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323743848f174ae7a70cc2d0952db4e1', 'request_id': 'req-1448d3a1-6ae9-4219-b81c-5d5852d211c6'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.665179 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323743848f174ae7a70cc2d0952db4e1', 'request_id': 'req-1448d3a1-6ae9-4219-b81c-5d5852d211c6'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.674618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323743848f174ae7a70cc2d0952db4e1', 'request_id': 'req-1448d3a1-6ae9-4219-b81c-5d5852d211c6'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.685104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] The token cache is being invalidate because project 323743848f174ae7a70cc2d0952db4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:35:02.685413 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.686065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-1448d3a1-6ae9-4219-b81c-5d5852d211c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:02.687762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1324/2620] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:35:02 2022] DELETE /identity/v3/projects/323743848f174ae7a70cc2d0952db4e1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:35:03.091942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c3af7-9107-4e14-a1a2-c9f4bd4a65a2 None None] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:03.092620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c3af7-9107-4e14-a1a2-c9f4bd4a65a2 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:03.092620 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c3af7-9107-4e14-a1a2-c9f4bd4a65a2 None None] PATH_INFO: `/` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:03.094178 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1297/2621] 10.222.0.32 () {54 vars in 921 bytes} [Tue Apr 12 00:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:35:03.099682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26899af3-ec34-4be0-bf31-bd0dfd10ce6a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:03.100098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26899af3-ec34-4be0-bf31-bd0dfd10ce6a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:03.100475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26899af3-ec34-4be0-bf31-bd0dfd10ce6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:03.118937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-26899af3-ec34-4be0-bf31-bd0dfd10ce6a None None] MFA Rules not processed for user `ecf0479293de4edfbf2815c1e9f2f7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:35:03.120203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-26899af3-ec34-4be0-bf31-bd0dfd10ce6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:03.184910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1325/2622] 10.222.0.32 () {58 vars in 1018 bytes} [Tue Apr 12 00:35:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:35:03.197539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c3af7-9107-4e14-a1a2-c9f4bd4a65a2 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:03.199247 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-090c3af7-9107-4e14-a1a2-c9f4bd4a65a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:03.258570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c3af7-9107-4e14-a1a2-c9f4bd4a65a2 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:03.262174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d3087-eeaf-4bb7-b525-3b18d5932e0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaf01f45e7a429e9361eb176a3f7c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:03.262926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d3087-eeaf-4bb7-b525-3b18d5932e0c service glance] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:03.263325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d3087-eeaf-4bb7-b525-3b18d5932e0c service glance] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:03.263665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d3087-eeaf-4bb7-b525-3b18d5932e0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:03.274501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d3087-eeaf-4bb7-b525-3b18d5932e0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:03.275910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d3087-eeaf-4bb7-b525-3b18d5932e0c service glance] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:03.287583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1298/2623] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:35:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:35:04.970530 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b367e-123f-4e64-b0e4-c946e9575420 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:04.971013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b367e-123f-4e64-b0e4-c946e9575420 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:04.971108 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b367e-123f-4e64-b0e4-c946e9575420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:04.987991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-546b367e-123f-4e64-b0e4-c946e9575420 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:35:04.989161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-546b367e-123f-4e64-b0e4-c946e9575420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:05.040671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1326/2624] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:35:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:35:05.052502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d3087-eeaf-4bb7-b525-3b18d5932e0c service glance] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:05.053874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-839d3087-eeaf-4bb7-b525-3b18d5932e0c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:05.120409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d3087-eeaf-4bb7-b525-3b18d5932e0c service glance] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:05.125429 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbe8be-277e-4aa0-9610-e742d6a731da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:05.126705 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbe8be-277e-4aa0-9610-e742d6a731da service swift] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:05.126994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbe8be-277e-4aa0-9610-e742d6a731da service swift] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:05.127277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbe8be-277e-4aa0-9610-e742d6a731da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:05.135269 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbe8be-277e-4aa0-9610-e742d6a731da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:05.136841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbe8be-277e-4aa0-9610-e742d6a731da service swift] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:05.145012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1299/2625] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:35:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:35:25.774102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752d4a3-ab06-4f25-bfa3-66437405a286 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:25.774660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752d4a3-ab06-4f25-bfa3-66437405a286 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:25.774770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752d4a3-ab06-4f25-bfa3-66437405a286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:25.792041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-3752d4a3-ab06-4f25-bfa3-66437405a286 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:35:25.793195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3752d4a3-ab06-4f25-bfa3-66437405a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:25.800003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1327/2626] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 00:35:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:35:25.811835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbe8be-277e-4aa0-9610-e742d6a731da service swift] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:25.822060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbe8be-277e-4aa0-9610-e742d6a731da service swift] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:25.827028 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355ee84-b227-47b2-98cc-eaebcbd13c7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:25.827660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355ee84-b227-47b2-98cc-eaebcbd13c7f service swift] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:25.827947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355ee84-b227-47b2-98cc-eaebcbd13c7f service swift] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:25.828225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355ee84-b227-47b2-98cc-eaebcbd13c7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:25.836533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355ee84-b227-47b2-98cc-eaebcbd13c7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:25.838182 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355ee84-b227-47b2-98cc-eaebcbd13c7f service swift] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:25.847020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1300/2627] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:35:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:35:28.081604 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752d4a3-ab06-4f25-bfa3-66437405a286 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:28.082993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3752d4a3-ab06-4f25-bfa3-66437405a286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:28.135719 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752d4a3-ab06-4f25-bfa3-66437405a286 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:28.139514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:28.140153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:28.140438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:28.141006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:28.142776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:28.198543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:28.200003 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:28.208673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1328/2628] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:35:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:35:33.135479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355ee84-b227-47b2-98cc-eaebcbd13c7f service swift] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:33.136969 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7355ee84-b227-47b2-98cc-eaebcbd13c7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:33.149564 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355ee84-b227-47b2-98cc-eaebcbd13c7f service swift] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:33.153086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e9f3b-e2a8-47ed-9280-8321c34d5429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:33.153721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9f3b-e2a8-47ed-9280-8321c34d5429 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:33.154003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9f3b-e2a8-47ed-9280-8321c34d5429 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:33.154300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9f3b-e2a8-47ed-9280-8321c34d5429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:33.156008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-953e9f3b-e2a8-47ed-9280-8321c34d5429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:33.216527 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e9f3b-e2a8-47ed-9280-8321c34d5429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:33.217935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e9f3b-e2a8-47ed-9280-8321c34d5429 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:33.227130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1301/2629] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:35:39.596220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:39.598077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:39.627462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2220c-0203-445d-b933-1c6a64035064 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:39.627462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:39.627462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:39.627462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:39.627972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] PATH_INFO: `/v3/users/8ee7971dfb4e4c22aac3d97db9ee04d0` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:39.628097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee7971dfb4e4c22aac3d97db9ee04d0)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:39.632055 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:39.695814 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee7971dfb4e4c22aac3d97db9ee04d0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:39.702955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee7971dfb4e4c22aac3d97db9ee04d0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:39.710666 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee7971dfb4e4c22aac3d97db9ee04d0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:39.711431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee7971dfb4e4c22aac3d97db9ee04d0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:39.712150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee7971dfb4e4c22aac3d97db9ee04d0'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:39.730999 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1329/2630] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:35:39 2022] DELETE /identity/v3/users/8ee7971dfb4e4c22aac3d97db9ee04d0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:35:39.913061 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e9f3b-e2a8-47ed-9280-8321c34d5429 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:39.924435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e9f3b-e2a8-47ed-9280-8321c34d5429 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:39.978911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:39.979849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:39.980168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:39.980464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] PATH_INFO: `/v3/projects/c03f71e524b24b8abf5e7c81842f4e75` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:39.981734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03f71e524b24b8abf5e7c81842f4e75)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:39.983687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:40.028403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03f71e524b24b8abf5e7c81842f4e75', 'request_id': 'req-c531d1ed-5eea-4a16-81f6-ab887561d882'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.034415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03f71e524b24b8abf5e7c81842f4e75', 'request_id': 'req-c531d1ed-5eea-4a16-81f6-ab887561d882'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.040185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03f71e524b24b8abf5e7c81842f4e75', 'request_id': 'req-c531d1ed-5eea-4a16-81f6-ab887561d882'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.055440 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] The token cache is being invalidate because project c03f71e524b24b8abf5e7c81842f4e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:35:40.055729 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.056361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.057913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1302/2631] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:35:39 2022] DELETE /identity/v3/projects/c03f71e524b24b8abf5e7c81842f4e75 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:35:40.061720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:40.063335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:40.076077 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d298-31c9-4871-83df-a79212f2dfeb admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:40.131885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:40.132660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:40.132990 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:40.133265 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] PATH_INFO: `/v3/users/559da777fad94426a9820ed6aa6f598c` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:40.134475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] RBAC: Authorizing `identity:delete_user(user_id=559da777fad94426a9820ed6aa6f598c)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:40.136357 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:40.184384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559da777fad94426a9820ed6aa6f598c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.191060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559da777fad94426a9820ed6aa6f598c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.198068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559da777fad94426a9820ed6aa6f598c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.198779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559da777fad94426a9820ed6aa6f598c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.199387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559da777fad94426a9820ed6aa6f598c'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.216186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1330/2632] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:35:40 2022] DELETE /identity/v3/users/559da777fad94426a9820ed6aa6f598c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:35:40.382646 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:40.384018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:40.397351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531d1ed-5eea-4a16-81f6-ab887561d882 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:40.454708 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:40.455544 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:40.455821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:40.456089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] PATH_INFO: `/v3/projects/745d5f15b5cd44edad3d04af93236db9` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:40.457249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=745d5f15b5cd44edad3d04af93236db9)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:40.459193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:40.505712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '745d5f15b5cd44edad3d04af93236db9', 'request_id': 'req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.511539 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '745d5f15b5cd44edad3d04af93236db9', 'request_id': 'req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.516968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '745d5f15b5cd44edad3d04af93236db9', 'request_id': 'req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.528493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] The token cache is being invalidate because project 745d5f15b5cd44edad3d04af93236db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:35:40.528778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.529405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:35:40.530943 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1303/2633] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:35:40 2022] DELETE /identity/v3/projects/745d5f15b5cd44edad3d04af93236db9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:35:47.844770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:47.846206 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:47.902127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75202aa6-0547-4e1c-8f3e-46d3581a179c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:47.949140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00edcfd-de1d-4d2e-b71c-812acad6de59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:47.949780 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00edcfd-de1d-4d2e-b71c-812acad6de59 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:47.950062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00edcfd-de1d-4d2e-b71c-812acad6de59 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:47.950381 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00edcfd-de1d-4d2e-b71c-812acad6de59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:47.952100 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f00edcfd-de1d-4d2e-b71c-812acad6de59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:48.018070 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00edcfd-de1d-4d2e-b71c-812acad6de59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:48.019442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00edcfd-de1d-4d2e-b71c-812acad6de59 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:48.029884 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1331/2634] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:35:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:35:52.477837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:52.479318 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:52.491883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ae935-9b80-4169-9b9f-9241f1ee92aa admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:52.495498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:52.496127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:52.496411 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:52.496682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:52.498405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:52.573700 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:52.575168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:52.592516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1304/2635] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:35:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:35:56.126397 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00edcfd-de1d-4d2e-b71c-812acad6de59 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:35:56.134931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00edcfd-de1d-4d2e-b71c-812acad6de59 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:35:56.138523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:35:56.139160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:35:56.139444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:35:56.139720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:35:56.141764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:35:56.161976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:35:56.163424 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:35:56.174639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1332/2636] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:35:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:09.163102 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:09.164502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:09.218162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138e1d3-d736-468a-85dc-5938e5fa071a service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:09.221765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3612fe-2e2a-4994-897e-e057d2440231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:09.222430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3612fe-2e2a-4994-897e-e057d2440231 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:09.222723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3612fe-2e2a-4994-897e-e057d2440231 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:09.222990 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3612fe-2e2a-4994-897e-e057d2440231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:09.224722 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-1b3612fe-2e2a-4994-897e-e057d2440231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:09.283372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3612fe-2e2a-4994-897e-e057d2440231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:09.285035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3612fe-2e2a-4994-897e-e057d2440231 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:09.295198 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1305/2637] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:12.399115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:12.400721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:12.416164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebd8cf-a872-42e7-9055-9a26d4e29839 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:12.421078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:12.425612 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:12.425912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:12.426192 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] PATH_INFO: `/v3/users/e548e01902ba41e79667ed56d602f19a` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:12.428315 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e548e01902ba41e79667ed56d602f19a)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:12.431547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:12.479392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e548e01902ba41e79667ed56d602f19a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.486421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e548e01902ba41e79667ed56d602f19a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.493742 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e548e01902ba41e79667ed56d602f19a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.494411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e548e01902ba41e79667ed56d602f19a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.495024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-79be7b01-a694-4056-b181-bd55616ff8a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e548e01902ba41e79667ed56d602f19a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.511992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1333/2638] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:36:12 2022] DELETE /identity/v3/users/e548e01902ba41e79667ed56d602f19a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:12.682406 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3612fe-2e2a-4994-897e-e057d2440231 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:12.694767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3612fe-2e2a-4994-897e-e057d2440231 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:12.749968 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:12.750853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:12.751135 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:12.751409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] PATH_INFO: `/v3/projects/c08909d19c8341c5b47846b0cee54fd8` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:12.752569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08909d19c8341c5b47846b0cee54fd8)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:12.754485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:12.799062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08909d19c8341c5b47846b0cee54fd8', 'request_id': 'req-a92adc02-d644-4ec0-bb90-5e221bc19a38'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.804883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08909d19c8341c5b47846b0cee54fd8', 'request_id': 'req-a92adc02-d644-4ec0-bb90-5e221bc19a38'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.810278 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08909d19c8341c5b47846b0cee54fd8', 'request_id': 'req-a92adc02-d644-4ec0-bb90-5e221bc19a38'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.821979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] The token cache is being invalidate because project c08909d19c8341c5b47846b0cee54fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:36:12.822284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.822938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a92adc02-d644-4ec0-bb90-5e221bc19a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:12.824459 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1306/2639] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:36:12 2022] DELETE /identity/v3/projects/c08909d19c8341c5b47846b0cee54fd8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:12.829539 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25802ad-35c0-4bfb-af13-d88e0106bdbf None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:12.829936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25802ad-35c0-4bfb-af13-d88e0106bdbf None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:12.830219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25802ad-35c0-4bfb-af13-d88e0106bdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:12.848236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-f25802ad-35c0-4bfb-af13-d88e0106bdbf None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:12.849439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f25802ad-35c0-4bfb-af13-d88e0106bdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:12.906684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1334/2640] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:36:12.914563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5fb78-4094-4a45-8c64-797253f4c045 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:12.914878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5fb78-4094-4a45-8c64-797253f4c045 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:12.915156 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5fb78-4094-4a45-8c64-797253f4c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:12.933668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-92a5fb78-4094-4a45-8c64-797253f4c045 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:12.934974 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-92a5fb78-4094-4a45-8c64-797253f4c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:12.942942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1307/2641] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:12.947093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25802ad-35c0-4bfb-af13-d88e0106bdbf None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:12.956918 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25802ad-35c0-4bfb-af13-d88e0106bdbf None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:12.961623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99e27-ff54-485c-88c1-3a416d1571d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:12.962298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99e27-ff54-485c-88c1-3a416d1571d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:12.962590 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99e27-ff54-485c-88c1-3a416d1571d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:12.962899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99e27-ff54-485c-88c1-3a416d1571d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:12.963639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d99e27-ff54-485c-88c1-3a416d1571d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:36:12.963947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d99e27-ff54-485c-88c1-3a416d1571d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:12.965570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d99e27-ff54-485c-88c1-3a416d1571d4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:12.977171 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1335/2642] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:36:12.981309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5fb78-4094-4a45-8c64-797253f4c045 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:12.990952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5fb78-4094-4a45-8c64-797253f4c045 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:12.995639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4aadf-abf2-40d7-9d31-018b435d4538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:12.996280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4aadf-abf2-40d7-9d31-018b435d4538 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:12.996565 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4aadf-abf2-40d7-9d31-018b435d4538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:12.996841 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4aadf-abf2-40d7-9d31-018b435d4538 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:12.997536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4aadf-abf2-40d7-9d31-018b435d4538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:12.999462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4aadf-abf2-40d7-9d31-018b435d4538 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.024310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1308/2643] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:36:12 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:13.028243 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99e27-ff54-485c-88c1-3a416d1571d4 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.038421 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99e27-ff54-485c-88c1-3a416d1571d4 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.090098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f90ed-7d00-4452-9144-3ff48ab80943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.090775 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f90ed-7d00-4452-9144-3ff48ab80943 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.091056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f90ed-7d00-4452-9144-3ff48ab80943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.091327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f90ed-7d00-4452-9144-3ff48ab80943 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.092002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f90ed-7d00-4452-9144-3ff48ab80943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.094515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f90ed-7d00-4452-9144-3ff48ab80943 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.113352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1336/2644] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:36:13 2022] POST /identity/v3/users => generated 293 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:13.117376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4aadf-abf2-40d7-9d31-018b435d4538 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.127289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4aadf-abf2-40d7-9d31-018b435d4538 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.131819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d68211-b365-4552-992c-f227d220db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.132464 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d68211-b365-4552-992c-f227d220db16 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.132748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d68211-b365-4552-992c-f227d220db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.133024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d68211-b365-4552-992c-f227d220db16 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.133739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d68211-b365-4552-992c-f227d220db16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.135353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d68211-b365-4552-992c-f227d220db16 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.147019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1309/2645] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:13.150757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f90ed-7d00-4452-9144-3ff48ab80943 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.160769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f90ed-7d00-4452-9144-3ff48ab80943 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.165322 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115336f-9782-4075-afa2-7673dc4019b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.165968 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115336f-9782-4075-afa2-7673dc4019b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.166272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115336f-9782-4075-afa2-7673dc4019b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.166551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115336f-9782-4075-afa2-7673dc4019b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.167267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115336f-9782-4075-afa2-7673dc4019b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.168837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115336f-9782-4075-afa2-7673dc4019b5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.178380 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1337/2646] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:13.182224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d68211-b365-4552-992c-f227d220db16 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.192006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d68211-b365-4552-992c-f227d220db16 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.196563 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79df6a7-46c2-45eb-a03b-7a39f6564f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.197424 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79df6a7-46c2-45eb-a03b-7a39f6564f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.197734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79df6a7-46c2-45eb-a03b-7a39f6564f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.198008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79df6a7-46c2-45eb-a03b-7a39f6564f4a admin admin] PATH_INFO: `/v3/projects/1abc9f494c8d42128c59681620230a20/users/0ea186c6a34a423ebdef636ec3001a9a/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.212458 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79df6a7-46c2-45eb-a03b-7a39f6564f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abc9f494c8d42128c59681620230a20, user_id=0ea186c6a34a423ebdef636ec3001a9a, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.215194 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79df6a7-46c2-45eb-a03b-7a39f6564f4a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.228138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1310/2647] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:36:13 2022] PUT /identity/v3/projects/1abc9f494c8d42128c59681620230a20/users/0ea186c6a34a423ebdef636ec3001a9a/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:36:13.238984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bfe75-3fc7-457d-abed-79c11c93e4e9 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.239275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bfe75-3fc7-457d-abed-79c11c93e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.239554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bfe75-3fc7-457d-abed-79c11c93e4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.264673 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-829bfe75-3fc7-457d-abed-79c11c93e4e9 None None] MFA Rules not processed for user `0ea186c6a34a423ebdef636ec3001a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:13.266655 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-829bfe75-3fc7-457d-abed-79c11c93e4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:13.325902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1338/2648] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:13.331483 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79df6a7-46c2-45eb-a03b-7a39f6564f4a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.390338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79df6a7-46c2-45eb-a03b-7a39f6564f4a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.395302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f5c5-ce6b-4003-8e02-a3a317b91670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.395986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f5c5-ce6b-4003-8e02-a3a317b91670 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.396272 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f5c5-ce6b-4003-8e02-a3a317b91670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.396546 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f5c5-ce6b-4003-8e02-a3a317b91670 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.397214 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f5c5-ce6b-4003-8e02-a3a317b91670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.399118 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f5c5-ce6b-4003-8e02-a3a317b91670 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.423668 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1311/2649] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:36:13 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:13.427617 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bfe75-3fc7-457d-abed-79c11c93e4e9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.437885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bfe75-3fc7-457d-abed-79c11c93e4e9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.490306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8517c-fd08-4b0d-909a-fa6e6f14cc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.490891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8517c-fd08-4b0d-909a-fa6e6f14cc22 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.491177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8517c-fd08-4b0d-909a-fa6e6f14cc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.491449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8517c-fd08-4b0d-909a-fa6e6f14cc22 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.492130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8517c-fd08-4b0d-909a-fa6e6f14cc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.494008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8517c-fd08-4b0d-909a-fa6e6f14cc22 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.514868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1339/2650] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:36:13 2022] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:13.519200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f5c5-ce6b-4003-8e02-a3a317b91670 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.529570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f5c5-ce6b-4003-8e02-a3a317b91670 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.534494 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf0c52-ef90-4628-a2ec-05f8fb1b4904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.535166 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf0c52-ef90-4628-a2ec-05f8fb1b4904 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.535446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf0c52-ef90-4628-a2ec-05f8fb1b4904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.535719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf0c52-ef90-4628-a2ec-05f8fb1b4904 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.536441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf0c52-ef90-4628-a2ec-05f8fb1b4904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.538062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf0c52-ef90-4628-a2ec-05f8fb1b4904 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.548545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1312/2651] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:13.552745 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8517c-fd08-4b0d-909a-fa6e6f14cc22 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.563603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8517c-fd08-4b0d-909a-fa6e6f14cc22 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.568318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456d99f-080a-4e48-851a-67642717b616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.569249 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456d99f-080a-4e48-851a-67642717b616 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.569525 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456d99f-080a-4e48-851a-67642717b616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.569828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456d99f-080a-4e48-851a-67642717b616 admin admin] PATH_INFO: `/v3/projects/298adfef9d7049268f77d6652c10b450/users/0b3956498bcd43448126cc28dd24f11c/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.585642 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456d99f-080a-4e48-851a-67642717b616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=298adfef9d7049268f77d6652c10b450, user_id=0b3956498bcd43448126cc28dd24f11c, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.588384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9456d99f-080a-4e48-851a-67642717b616 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.602233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1340/2652] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:36:13 2022] PUT /identity/v3/projects/298adfef9d7049268f77d6652c10b450/users/0b3956498bcd43448126cc28dd24f11c/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:36:13.606202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf0c52-ef90-4628-a2ec-05f8fb1b4904 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.616848 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf0c52-ef90-4628-a2ec-05f8fb1b4904 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.670836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ead33-d6f6-42a6-adf8-8f5e767f5bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.671501 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ead33-d6f6-42a6-adf8-8f5e767f5bab admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.671810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ead33-d6f6-42a6-adf8-8f5e767f5bab admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.672232 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ead33-d6f6-42a6-adf8-8f5e767f5bab admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.672811 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ead33-d6f6-42a6-adf8-8f5e767f5bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.674482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ead33-d6f6-42a6-adf8-8f5e767f5bab admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.684014 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1313/2653] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:13.688684 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456d99f-080a-4e48-851a-67642717b616 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.698722 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456d99f-080a-4e48-851a-67642717b616 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.703953 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8029-34e6-4536-b128-9e0b2f1e9a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.704828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8029-34e6-4536-b128-9e0b2f1e9a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.705113 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8029-34e6-4536-b128-9e0b2f1e9a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.705393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8029-34e6-4536-b128-9e0b2f1e9a3b admin admin] PATH_INFO: `/v3/projects/298adfef9d7049268f77d6652c10b450/users/0b3956498bcd43448126cc28dd24f11c/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.707374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed8029-34e6-4536-b128-9e0b2f1e9a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=298adfef9d7049268f77d6652c10b450, user_id=0b3956498bcd43448126cc28dd24f11c, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.710036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed8029-34e6-4536-b128-9e0b2f1e9a3b admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.719941 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1341/2654] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:36:13 2022] PUT /identity/v3/projects/298adfef9d7049268f77d6652c10b450/users/0b3956498bcd43448126cc28dd24f11c/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:13.729831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4e16d-8315-40f3-88e5-0c1c4fdb8f7d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.730127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4e16d-8315-40f3-88e5-0c1c4fdb8f7d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.730441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4e16d-8315-40f3-88e5-0c1c4fdb8f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.755964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-85b4e16d-8315-40f3-88e5-0c1c4fdb8f7d None None] MFA Rules not processed for user `0b3956498bcd43448126cc28dd24f11c`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:13.757082 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-85b4e16d-8315-40f3-88e5-0c1c4fdb8f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:13.821336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1314/2655] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:13.832230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8029-34e6-4536-b128-9e0b2f1e9a3b admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:13.833992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3aed8029-34e6-4536-b128-9e0b2f1e9a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:13.890479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8029-34e6-4536-b128-9e0b2f1e9a3b admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:13.894485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0756414-03cb-415c-8fe3-c83641fba469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:13.895124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0756414-03cb-415c-8fe3-c83641fba469 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:13.895408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0756414-03cb-415c-8fe3-c83641fba469 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:13.895682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0756414-03cb-415c-8fe3-c83641fba469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:13.904668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0756414-03cb-415c-8fe3-c83641fba469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:13.906103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0756414-03cb-415c-8fe3-c83641fba469 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:13.915406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1342/2656] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:14.036878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4e16d-8315-40f3-88e5-0c1c4fdb8f7d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:14.095473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4e16d-8315-40f3-88e5-0c1c4fdb8f7d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:14.099967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:14.100821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:14.101106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:14.101377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] PATH_INFO: `/v3/users/0ea186c6a34a423ebdef636ec3001a9a` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:14.102605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea186c6a34a423ebdef636ec3001a9a)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:14.104498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:14.147814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea186c6a34a423ebdef636ec3001a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.154398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea186c6a34a423ebdef636ec3001a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.162404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea186c6a34a423ebdef636ec3001a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.163017 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea186c6a34a423ebdef636ec3001a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.163615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea186c6a34a423ebdef636ec3001a9a'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.179819 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1315/2657] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:36:14 2022] DELETE /identity/v3/users/0ea186c6a34a423ebdef636ec3001a9a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:14.184316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3582a9-1bca-424a-beca-541a6bb2a2c0 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:14.184606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3582a9-1bca-424a-beca-541a6bb2a2c0 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:14.184887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3582a9-1bca-424a-beca-541a6bb2a2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:14.204137 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-fd3582a9-1bca-424a-beca-541a6bb2a2c0 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:14.205336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fd3582a9-1bca-424a-beca-541a6bb2a2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:14.262284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1343/2658] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:14.273035 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:14.274656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:14.330271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d451d1c-fa22-4b1e-ad6e-e5c8259c3f2f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:14.333912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cd5da-68c2-4c60-8ba6-526c35bdf294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:14.334573 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cd5da-68c2-4c60-8ba6-526c35bdf294 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:14.334855 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cd5da-68c2-4c60-8ba6-526c35bdf294 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:14.335127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cd5da-68c2-4c60-8ba6-526c35bdf294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:14.343924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cd5da-68c2-4c60-8ba6-526c35bdf294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:14.345321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cd5da-68c2-4c60-8ba6-526c35bdf294 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:14.354416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1316/2659] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:14.615740 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3582a9-1bca-424a-beca-541a6bb2a2c0 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:14.618056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-fd3582a9-1bca-424a-beca-541a6bb2a2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:14.637594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3582a9-1bca-424a-beca-541a6bb2a2c0 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:14.642817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:14.643675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:14.643956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:14.644256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] PATH_INFO: `/v3/projects/1abc9f494c8d42128c59681620230a20` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:14.645493 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abc9f494c8d42128c59681620230a20)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:14.647467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:14.692212 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abc9f494c8d42128c59681620230a20', 'request_id': 'req-0f3f6fc1-249c-4b06-9602-691c593fbfc9'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.698699 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abc9f494c8d42128c59681620230a20', 'request_id': 'req-0f3f6fc1-249c-4b06-9602-691c593fbfc9'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.704716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abc9f494c8d42128c59681620230a20', 'request_id': 'req-0f3f6fc1-249c-4b06-9602-691c593fbfc9'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.714440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] The token cache is being invalidate because project 1abc9f494c8d42128c59681620230a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:36:14.714726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.715350 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.716880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1344/2660] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:36:14 2022] DELETE /identity/v3/projects/1abc9f494c8d42128c59681620230a20 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:14.720830 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cd5da-68c2-4c60-8ba6-526c35bdf294 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:14.730146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cd5da-68c2-4c60-8ba6-526c35bdf294 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:14.783389 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:14.784168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:14.784450 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:14.784721 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] PATH_INFO: `/v3/users/0b3956498bcd43448126cc28dd24f11c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:14.785884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3956498bcd43448126cc28dd24f11c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:14.787806 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:14.830822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3956498bcd43448126cc28dd24f11c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.837526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3956498bcd43448126cc28dd24f11c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.845207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3956498bcd43448126cc28dd24f11c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.845883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3956498bcd43448126cc28dd24f11c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.846510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ff3cea9e-246c-41aa-8c34-1430dbd1e8e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3956498bcd43448126cc28dd24f11c'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:14.862794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1317/2661] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:36:14 2022] DELETE /identity/v3/users/0b3956498bcd43448126cc28dd24f11c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:15.120087 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:15.121614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:15.135201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f6fc1-249c-4b06-9602-691c593fbfc9 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:15.190960 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:15.191806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.192085 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.192354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] PATH_INFO: `/v3/projects/298adfef9d7049268f77d6652c10b450` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.193497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=298adfef9d7049268f77d6652c10b450)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:15.195583 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:15.238491 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298adfef9d7049268f77d6652c10b450', 'request_id': 'req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:15.245136 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298adfef9d7049268f77d6652c10b450', 'request_id': 'req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:15.251632 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298adfef9d7049268f77d6652c10b450', 'request_id': 'req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:15.261176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] The token cache is being invalidate because project 298adfef9d7049268f77d6652c10b450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:36:15.261461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:15.262079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-cc8bd2ab-ce39-4887-b05f-3537ebfb37d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:15.263598 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1345/2662] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:36:15 2022] DELETE /identity/v3/projects/298adfef9d7049268f77d6652c10b450 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:36:15.269177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f2651-41ff-4896-ba6c-c6333de1c360 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.269496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f2651-41ff-4896-ba6c-c6333de1c360 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.269780 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f2651-41ff-4896-ba6c-c6333de1c360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.288883 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b42f2651-41ff-4896-ba6c-c6333de1c360 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:15.290101 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b42f2651-41ff-4896-ba6c-c6333de1c360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:15.346202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1318/2663] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:15.354199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff86ef1-94a4-4688-b061-671338fb47c3 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.354522 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff86ef1-94a4-4688-b061-671338fb47c3 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.354806 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff86ef1-94a4-4688-b061-671338fb47c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.372746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-bff86ef1-94a4-4688-b061-671338fb47c3 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:15.373928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bff86ef1-94a4-4688-b061-671338fb47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:15.382346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1346/2664] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:15.386276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f2651-41ff-4896-ba6c-c6333de1c360 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:15.395886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f2651-41ff-4896-ba6c-c6333de1c360 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:15.400598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f9095-d84c-4d3a-980b-a8baaca44f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:15.401245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f9095-d84c-4d3a-980b-a8baaca44f0f admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.401551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f9095-d84c-4d3a-980b-a8baaca44f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.401853 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f9095-d84c-4d3a-980b-a8baaca44f0f admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.402635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f9095-d84c-4d3a-980b-a8baaca44f0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:36:15.402971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f9095-d84c-4d3a-980b-a8baaca44f0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:15.404623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f9095-d84c-4d3a-980b-a8baaca44f0f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:15.415832 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1319/2665] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:36:15.420117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff86ef1-94a4-4688-b061-671338fb47c3 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:15.429395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff86ef1-94a4-4688-b061-671338fb47c3 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:15.433995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b0639-36e5-4967-96b7-92f49219eb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:15.434665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b0639-36e5-4967-96b7-92f49219eb7f admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.434947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b0639-36e5-4967-96b7-92f49219eb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.435219 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b0639-36e5-4967-96b7-92f49219eb7f admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.435894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b0639-36e5-4967-96b7-92f49219eb7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:15.438417 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b0639-36e5-4967-96b7-92f49219eb7f admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:15.462162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1347/2666] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:36:15 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:36:15.466336 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f9095-d84c-4d3a-980b-a8baaca44f0f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:15.476271 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f9095-d84c-4d3a-980b-a8baaca44f0f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:15.530789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215281b4-1d58-4047-a50a-36a24d8a19ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:15.532036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215281b4-1d58-4047-a50a-36a24d8a19ed admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.532311 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215281b4-1d58-4047-a50a-36a24d8a19ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.532579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215281b4-1d58-4047-a50a-36a24d8a19ed admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.533255 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215281b4-1d58-4047-a50a-36a24d8a19ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:15.535153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215281b4-1d58-4047-a50a-36a24d8a19ed admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:15.556376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1320/2667] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:36:15 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:15.557554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b0639-36e5-4967-96b7-92f49219eb7f admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:15.567352 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b0639-36e5-4967-96b7-92f49219eb7f admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:15.571920 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbbf1-d728-4a3a-a14c-36ff56b80ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:15.572564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbbf1-d728-4a3a-a14c-36ff56b80ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.572841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbbf1-d728-4a3a-a14c-36ff56b80ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.573114 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecbbf1-d728-4a3a-a14c-36ff56b80ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.573841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecbbf1-d728-4a3a-a14c-36ff56b80ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:15.575445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecbbf1-d728-4a3a-a14c-36ff56b80ee4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:15.585770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1348/2668] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:15.589471 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215281b4-1d58-4047-a50a-36a24d8a19ed admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:15.599500 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215281b4-1d58-4047-a50a-36a24d8a19ed admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:15.603924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161122e-76fb-4748-abc5-6a8508ed7a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:15.604557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161122e-76fb-4748-abc5-6a8508ed7a4b admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.604836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161122e-76fb-4748-abc5-6a8508ed7a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.605108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161122e-76fb-4748-abc5-6a8508ed7a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.605813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161122e-76fb-4748-abc5-6a8508ed7a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:15.607419 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161122e-76fb-4748-abc5-6a8508ed7a4b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:15.616705 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1321/2669] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:15.620569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbbf1-d728-4a3a-a14c-36ff56b80ee4 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:15.631023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecbbf1-d728-4a3a-a14c-36ff56b80ee4 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:15.635553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3841e-3631-4a25-bbd8-d7d79b10ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:15.636458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3841e-3631-4a25-bbd8-d7d79b10ae77 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.636738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3841e-3631-4a25-bbd8-d7d79b10ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.637009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3841e-3631-4a25-bbd8-d7d79b10ae77 admin admin] PATH_INFO: `/v3/projects/217de80a63014854920d48cfd475d098/users/cf42389152354df3a3ce8adbfa0db37e/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.650975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3841e-3631-4a25-bbd8-d7d79b10ae77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217de80a63014854920d48cfd475d098, user_id=cf42389152354df3a3ce8adbfa0db37e, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:15.653553 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3841e-3631-4a25-bbd8-d7d79b10ae77 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:15.667518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1349/2670] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:36:15 2022] PUT /identity/v3/projects/217de80a63014854920d48cfd475d098/users/cf42389152354df3a3ce8adbfa0db37e/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:15.673350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce9aaa-f3cd-46ed-bd6c-7b58edc70163 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.673621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce9aaa-f3cd-46ed-bd6c-7b58edc70163 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.673892 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce9aaa-f3cd-46ed-bd6c-7b58edc70163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.690872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d9ce9aaa-f3cd-46ed-bd6c-7b58edc70163 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:15.692050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d9ce9aaa-f3cd-46ed-bd6c-7b58edc70163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:15.746461 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1322/2671] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:15.755896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3841e-3631-4a25-bbd8-d7d79b10ae77 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:15.757543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4de3841e-3631-4a25-bbd8-d7d79b10ae77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:15.811021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3841e-3631-4a25-bbd8-d7d79b10ae77 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:15.814631 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045feb49-82de-492d-869b-355b6ca469be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:15.815262 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045feb49-82de-492d-869b-355b6ca469be service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:15.815541 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045feb49-82de-492d-869b-355b6ca469be service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:15.815815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045feb49-82de-492d-869b-355b6ca469be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:15.824488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045feb49-82de-492d-869b-355b6ca469be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:15.825909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045feb49-82de-492d-869b-355b6ca469be service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:15.834988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1350/2672] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:16.398474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836003d-504e-4435-ae07-c139324ef27b None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:16.398767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836003d-504e-4435-ae07-c139324ef27b None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:16.399049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836003d-504e-4435-ae07-c139324ef27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:16.424244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b836003d-504e-4435-ae07-c139324ef27b None None] MFA Rules not processed for user `cf42389152354df3a3ce8adbfa0db37e`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:16.425460 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b836003d-504e-4435-ae07-c139324ef27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:16.490022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1323/2673] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:16.494241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045feb49-82de-492d-869b-355b6ca469be service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:16.504083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045feb49-82de-492d-869b-355b6ca469be service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:16.508552 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d0af3-1cfd-4368-bdc8-12e5e3620a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:16.509196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d0af3-1cfd-4368-bdc8-12e5e3620a21 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:16.509479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d0af3-1cfd-4368-bdc8-12e5e3620a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:16.509753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d0af3-1cfd-4368-bdc8-12e5e3620a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:16.510472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d0af3-1cfd-4368-bdc8-12e5e3620a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:16.512383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d0af3-1cfd-4368-bdc8-12e5e3620a21 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:16.540671 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1351/2674] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:36:16 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:16.542925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836003d-504e-4435-ae07-c139324ef27b None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:16.553356 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836003d-504e-4435-ae07-c139324ef27b None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:16.608542 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b57b82-2f41-4671-8915-53f7e103d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:16.609227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b57b82-2f41-4671-8915-53f7e103d219 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:16.609509 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b57b82-2f41-4671-8915-53f7e103d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:16.609785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b57b82-2f41-4671-8915-53f7e103d219 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:16.610493 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b57b82-2f41-4671-8915-53f7e103d219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:16.612395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b57b82-2f41-4671-8915-53f7e103d219 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:16.632179 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1324/2675] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:36:16 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:16.636068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d0af3-1cfd-4368-bdc8-12e5e3620a21 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:16.647034 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d0af3-1cfd-4368-bdc8-12e5e3620a21 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:16.651535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70719fdc-6759-4d0d-a1cc-468cd99bd7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:16.652191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70719fdc-6759-4d0d-a1cc-468cd99bd7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:16.652475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70719fdc-6759-4d0d-a1cc-468cd99bd7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:16.652752 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70719fdc-6759-4d0d-a1cc-468cd99bd7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:16.653472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70719fdc-6759-4d0d-a1cc-468cd99bd7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:16.655098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70719fdc-6759-4d0d-a1cc-468cd99bd7d0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:16.665289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1352/2676] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:16.669474 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b57b82-2f41-4671-8915-53f7e103d219 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:16.679238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b57b82-2f41-4671-8915-53f7e103d219 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:16.683752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2301910-b024-479d-aa53-86603b0aa3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:16.684618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2301910-b024-479d-aa53-86603b0aa3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:16.684901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2301910-b024-479d-aa53-86603b0aa3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:16.685174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2301910-b024-479d-aa53-86603b0aa3a5 admin admin] PATH_INFO: `/v3/projects/d9ad251c924740b8a3ccf9e2251db734/users/3d26e9b1ea604202bc93a7cafa355783/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:16.699754 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2301910-b024-479d-aa53-86603b0aa3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ad251c924740b8a3ccf9e2251db734, user_id=3d26e9b1ea604202bc93a7cafa355783, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:16.702408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2301910-b024-479d-aa53-86603b0aa3a5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:16.714597 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1325/2677] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:36:16 2022] PUT /identity/v3/projects/d9ad251c924740b8a3ccf9e2251db734/users/3d26e9b1ea604202bc93a7cafa355783/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:16.718950 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70719fdc-6759-4d0d-a1cc-468cd99bd7d0 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:16.728658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70719fdc-6759-4d0d-a1cc-468cd99bd7d0 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:16.782813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f6a40-55a9-4541-8287-f06706c72a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:16.783466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6a40-55a9-4541-8287-f06706c72a6a admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:16.783746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6a40-55a9-4541-8287-f06706c72a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:16.784016 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f6a40-55a9-4541-8287-f06706c72a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:16.784721 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6a40-55a9-4541-8287-f06706c72a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:16.786286 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f6a40-55a9-4541-8287-f06706c72a6a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:16.795478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1353/2678] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:36:16.799557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2301910-b024-479d-aa53-86603b0aa3a5 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:16.809470 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2301910-b024-479d-aa53-86603b0aa3a5 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:16.813959 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977490d-8687-4736-a13c-4cb8777c2e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:16.814847 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977490d-8687-4736-a13c-4cb8777c2e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:16.815127 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977490d-8687-4736-a13c-4cb8777c2e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:16.815398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977490d-8687-4736-a13c-4cb8777c2e39 admin admin] PATH_INFO: `/v3/projects/d9ad251c924740b8a3ccf9e2251db734/users/3d26e9b1ea604202bc93a7cafa355783/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:16.817321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977490d-8687-4736-a13c-4cb8777c2e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ad251c924740b8a3ccf9e2251db734, user_id=3d26e9b1ea604202bc93a7cafa355783, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:16.819947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977490d-8687-4736-a13c-4cb8777c2e39 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:16.830395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1326/2679] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:36:16 2022] PUT /identity/v3/projects/d9ad251c924740b8a3ccf9e2251db734/users/3d26e9b1ea604202bc93a7cafa355783/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:17.401753 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a931e-4819-42a1-b81e-e74ad59d1e72 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:17.402270 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a931e-4819-42a1-b81e-e74ad59d1e72 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:17.402743 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a931e-4819-42a1-b81e-e74ad59d1e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:17.430142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b26a931e-4819-42a1-b81e-e74ad59d1e72 None None] MFA Rules not processed for user `3d26e9b1ea604202bc93a7cafa355783`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:17.431396 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b26a931e-4819-42a1-b81e-e74ad59d1e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:17.497011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1354/2680] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:17.509456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977490d-8687-4736-a13c-4cb8777c2e39 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:17.511333 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-8977490d-8687-4736-a13c-4cb8777c2e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:17.567517 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977490d-8687-4736-a13c-4cb8777c2e39 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:17.571145 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01098ea-9873-4b85-aaaa-2ee106b673bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:17.571784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01098ea-9873-4b85-aaaa-2ee106b673bf service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:17.572063 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01098ea-9873-4b85-aaaa-2ee106b673bf service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:17.572337 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01098ea-9873-4b85-aaaa-2ee106b673bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:17.626019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01098ea-9873-4b85-aaaa-2ee106b673bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:17.627516 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01098ea-9873-4b85-aaaa-2ee106b673bf service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:17.636005 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1327/2681] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:18.966342 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a931e-4819-42a1-b81e-e74ad59d1e72 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:18.969093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b26a931e-4819-42a1-b81e-e74ad59d1e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:18.980797 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a931e-4819-42a1-b81e-e74ad59d1e72 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:18.984315 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29b07-c3cd-46db-a673-064b7e1869d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:18.984947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29b07-c3cd-46db-a673-064b7e1869d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:18.985902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29b07-c3cd-46db-a673-064b7e1869d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:18.986242 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29b07-c3cd-46db-a673-064b7e1869d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:18.995402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb29b07-c3cd-46db-a673-064b7e1869d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:18.996862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb29b07-c3cd-46db-a673-064b7e1869d0 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:19.006594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1355/2682] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:18 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:22.020568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01098ea-9873-4b85-aaaa-2ee106b673bf service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:22.028921 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01098ea-9873-4b85-aaaa-2ee106b673bf service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:22.032513 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15dc13-63de-41ed-8e17-1a8094a42c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:22.033126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15dc13-63de-41ed-8e17-1a8094a42c8d service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:22.033403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15dc13-63de-41ed-8e17-1a8094a42c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:22.033681 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15dc13-63de-41ed-8e17-1a8094a42c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:22.035437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-cd15dc13-63de-41ed-8e17-1a8094a42c8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:22.112109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15dc13-63de-41ed-8e17-1a8094a42c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:22.113519 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15dc13-63de-41ed-8e17-1a8094a42c8d service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:22.131591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1328/2683] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:27.133552 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29b07-c3cd-46db-a673-064b7e1869d0 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:27.143110 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29b07-c3cd-46db-a673-064b7e1869d0 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:27.146759 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5535b-3fd0-4dba-bac0-646cb8271de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:27.147418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5535b-3fd0-4dba-bac0-646cb8271de8 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:27.147705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5535b-3fd0-4dba-bac0-646cb8271de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:27.147986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5535b-3fd0-4dba-bac0-646cb8271de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:27.149816 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b7e5535b-3fd0-4dba-bac0-646cb8271de8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:27.207751 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5535b-3fd0-4dba-bac0-646cb8271de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:27.209172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5535b-3fd0-4dba-bac0-646cb8271de8 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:27.217891 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1356/2684] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:33.059298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15dc13-63de-41ed-8e17-1a8094a42c8d service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:33.112000 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15dc13-63de-41ed-8e17-1a8094a42c8d service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:33.115857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba9824-9591-4464-88e7-a855c42da259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:33.116505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba9824-9591-4464-88e7-a855c42da259 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:33.116787 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba9824-9591-4464-88e7-a855c42da259 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:33.117062 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba9824-9591-4464-88e7-a855c42da259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:33.118908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7bba9824-9591-4464-88e7-a855c42da259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:33.180688 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba9824-9591-4464-88e7-a855c42da259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:33.182144 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba9824-9591-4464-88e7-a855c42da259 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:33.191935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1329/2685] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:36:34.902419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5535b-3fd0-4dba-bac0-646cb8271de8 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:34.920482 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5535b-3fd0-4dba-bac0-646cb8271de8 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:34.927023 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:34.928062 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:34.928462 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:34.928815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] PATH_INFO: `/v3/users/cf42389152354df3a3ce8adbfa0db37e` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:34.930237 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf42389152354df3a3ce8adbfa0db37e)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:34.932257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:34.984367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf42389152354df3a3ce8adbfa0db37e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:34.991464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf42389152354df3a3ce8adbfa0db37e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:34.999213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf42389152354df3a3ce8adbfa0db37e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.000384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf42389152354df3a3ce8adbfa0db37e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.001466 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf42389152354df3a3ce8adbfa0db37e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.022986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1357/2686] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:36:34 2022] DELETE /identity/v3/users/cf42389152354df3a3ce8adbfa0db37e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:35.210965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba9824-9591-4464-88e7-a855c42da259 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:35.224978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba9824-9591-4464-88e7-a855c42da259 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:35.295765 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:35.297351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:35.297757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:35.298131 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] PATH_INFO: `/v3/projects/217de80a63014854920d48cfd475d098` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:35.299455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=217de80a63014854920d48cfd475d098)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:35.301486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:35.354686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217de80a63014854920d48cfd475d098', 'request_id': 'req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.361591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217de80a63014854920d48cfd475d098', 'request_id': 'req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.367398 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217de80a63014854920d48cfd475d098', 'request_id': 'req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.380332 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] The token cache is being invalidate because project 217de80a63014854920d48cfd475d098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:36:35.380619 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.381242 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.385837 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1330/2687] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:36:35 2022] DELETE /identity/v3/projects/217de80a63014854920d48cfd475d098 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:35.387236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:35.388886 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:35.405209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fd57e-d969-40b4-8be2-724f3b3ef35a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:35.466534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:35.467404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:35.467681 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:35.467948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] PATH_INFO: `/v3/users/3d26e9b1ea604202bc93a7cafa355783` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:35.469665 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d26e9b1ea604202bc93a7cafa355783)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:35.471634 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:35.518015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d26e9b1ea604202bc93a7cafa355783'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.525182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d26e9b1ea604202bc93a7cafa355783'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.533332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d26e9b1ea604202bc93a7cafa355783'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.534057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d26e9b1ea604202bc93a7cafa355783'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.534685 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-58e12c8e-c62e-4a5c-af13-43dd0507a95e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d26e9b1ea604202bc93a7cafa355783'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.551502 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1358/2688] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:36:35 2022] DELETE /identity/v3/users/3d26e9b1ea604202bc93a7cafa355783 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:35.802304 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:35.803898 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:35.833114 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51561f3-0d17-4e4d-a9ee-c1556eeb74bf admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:35.908899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:35.909775 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:35.910056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:35.910363 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] PATH_INFO: `/v3/projects/d9ad251c924740b8a3ccf9e2251db734` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:35.911590 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ad251c924740b8a3ccf9e2251db734)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:35.913511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:35.960482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ad251c924740b8a3ccf9e2251db734', 'request_id': 'req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.968078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ad251c924740b8a3ccf9e2251db734', 'request_id': 'req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:35.975993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ad251c924740b8a3ccf9e2251db734', 'request_id': 'req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:36.008656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] The token cache is being invalidate because project d9ad251c924740b8a3ccf9e2251db734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:36:36.008955 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:36.009627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0f0b1c8a-2d32-4fa5-be36-bafcc79ee924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:36.012338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1331/2689] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:36:35 2022] DELETE /identity/v3/projects/d9ad251c924740b8a3ccf9e2251db734 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:36.018649 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b2804-bc86-4193-9dad-a93b2d09e851 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.019173 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b2804-bc86-4193-9dad-a93b2d09e851 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.019173 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b2804-bc86-4193-9dad-a93b2d09e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.046822 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-9e2b2804-bc86-4193-9dad-a93b2d09e851 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:36.048183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9e2b2804-bc86-4193-9dad-a93b2d09e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:36.132564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1359/2690] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:36.141937 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6edf-5d80-4494-80a1-61894c088a6a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.142059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6edf-5d80-4494-80a1-61894c088a6a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.142387 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef6edf-5d80-4494-80a1-61894c088a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.165627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-91ef6edf-5d80-4494-80a1-61894c088a6a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:36.166988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-91ef6edf-5d80-4494-80a1-61894c088a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:36.175731 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1332/2691] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:36.181050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b2804-bc86-4193-9dad-a93b2d09e851 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:36.192307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b2804-bc86-4193-9dad-a93b2d09e851 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:36.202391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b1f4e-e458-4fb9-8735-cb6be92efb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:36.203628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b1f4e-e458-4fb9-8735-cb6be92efb9d admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.203628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b1f4e-e458-4fb9-8735-cb6be92efb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.204121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b1f4e-e458-4fb9-8735-cb6be92efb9d admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.204851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b1f4e-e458-4fb9-8735-cb6be92efb9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:36:36.205251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b1f4e-e458-4fb9-8735-cb6be92efb9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:36.207041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b1f4e-e458-4fb9-8735-cb6be92efb9d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:36.221186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1360/2692] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:36:36.225868 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef6edf-5d80-4494-80a1-61894c088a6a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:36.235912 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef6edf-5d80-4494-80a1-61894c088a6a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:36.241878 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace1b43-5613-4d3f-a442-0ada493d0479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:36.242760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace1b43-5613-4d3f-a442-0ada493d0479 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.243045 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace1b43-5613-4d3f-a442-0ada493d0479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.243320 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace1b43-5613-4d3f-a442-0ada493d0479 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.244003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace1b43-5613-4d3f-a442-0ada493d0479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:36.246067 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace1b43-5613-4d3f-a442-0ada493d0479 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:36.272260 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1333/2693] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:36:36 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:36.276813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b1f4e-e458-4fb9-8735-cb6be92efb9d admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:36.287115 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b1f4e-e458-4fb9-8735-cb6be92efb9d admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:36.356769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1375882-2a0a-4a25-96ad-2b62cfe48e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:36.357434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1375882-2a0a-4a25-96ad-2b62cfe48e85 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.357829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1375882-2a0a-4a25-96ad-2b62cfe48e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.358284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1375882-2a0a-4a25-96ad-2b62cfe48e85 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.359384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1375882-2a0a-4a25-96ad-2b62cfe48e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:36.361281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1375882-2a0a-4a25-96ad-2b62cfe48e85 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:36.383190 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1361/2694] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:36:36 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:36.386734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace1b43-5613-4d3f-a442-0ada493d0479 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:36.399693 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace1b43-5613-4d3f-a442-0ada493d0479 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:36.406597 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8a6d9-113e-4404-a586-9c2e3e7365ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:36.407224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8a6d9-113e-4404-a586-9c2e3e7365ac admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.407503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8a6d9-113e-4404-a586-9c2e3e7365ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.407776 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8a6d9-113e-4404-a586-9c2e3e7365ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.408496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8a6d9-113e-4404-a586-9c2e3e7365ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:36.410108 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8a6d9-113e-4404-a586-9c2e3e7365ac admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:36.421257 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1334/2695] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:36.424993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1375882-2a0a-4a25-96ad-2b62cfe48e85 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:36.441485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1375882-2a0a-4a25-96ad-2b62cfe48e85 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:36.446580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e8f15-9af0-402f-89ad-7c67d0792d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:36.447382 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8f15-9af0-402f-89ad-7c67d0792d70 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.447733 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8f15-9af0-402f-89ad-7c67d0792d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.448079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e8f15-9af0-402f-89ad-7c67d0792d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.449011 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e8f15-9af0-402f-89ad-7c67d0792d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:36.450653 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e8f15-9af0-402f-89ad-7c67d0792d70 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:36.461415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1362/2696] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:36:36.465568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8a6d9-113e-4404-a586-9c2e3e7365ac admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:36.475686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8a6d9-113e-4404-a586-9c2e3e7365ac admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:36.484357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3c8f3-86e6-41c3-8e6a-9628868ffec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:36.484357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3c8f3-86e6-41c3-8e6a-9628868ffec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.484357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3c8f3-86e6-41c3-8e6a-9628868ffec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.484357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3c8f3-86e6-41c3-8e6a-9628868ffec8 admin admin] PATH_INFO: `/v3/projects/37952e8e9e8d4fca9cc271a3684025c0/users/68041024e96942889244157e42139571/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.504998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3c8f3-86e6-41c3-8e6a-9628868ffec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37952e8e9e8d4fca9cc271a3684025c0, user_id=68041024e96942889244157e42139571, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:36.507718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3c8f3-86e6-41c3-8e6a-9628868ffec8 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:36.524164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1335/2697] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:36:36 2022] PUT /identity/v3/projects/37952e8e9e8d4fca9cc271a3684025c0/users/68041024e96942889244157e42139571/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:36.534306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3562-fafd-441e-b7ca-9eaede54bd1a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.534606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3562-fafd-441e-b7ca-9eaede54bd1a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.535075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e3562-fafd-441e-b7ca-9eaede54bd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.563543 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b37e3562-fafd-441e-b7ca-9eaede54bd1a None None] MFA Rules not processed for user `68041024e96942889244157e42139571`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:36.564898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b37e3562-fafd-441e-b7ca-9eaede54bd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:36.570821 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3c8f3-86e6-41c3-8e6a-9628868ffec8 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:36.572480 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-99f3c8f3-86e6-41c3-8e6a-9628868ffec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:36.635261 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1363/2698] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:36:36.637684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3c8f3-86e6-41c3-8e6a-9628868ffec8 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:36.642868 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:36.643742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.644025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.644298 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] PATH_INFO: `/v3/users/f0fad81c4cbd4335967e97fd7de9963d` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.646275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0fad81c4cbd4335967e97fd7de9963d)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:36.646800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3562-fafd-441e-b7ca-9eaede54bd1a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:36.648120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b37e3562-fafd-441e-b7ca-9eaede54bd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:36.648232 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:36.694561 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0fad81c4cbd4335967e97fd7de9963d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:36.701191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0fad81c4cbd4335967e97fd7de9963d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:36.706008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e3562-fafd-441e-b7ca-9eaede54bd1a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:36.707833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0fad81c4cbd4335967e97fd7de9963d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:36.708498 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0fad81c4cbd4335967e97fd7de9963d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:36.709191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0fad81c4cbd4335967e97fd7de9963d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:36.709888 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105886b-631f-4f7a-b9e7-a4eec683af3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaf01f45e7a429e9361eb176a3f7c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:36.710579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105886b-631f-4f7a-b9e7-a4eec683af3e service glance] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.710885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105886b-631f-4f7a-b9e7-a4eec683af3e service glance] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.711162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105886b-631f-4f7a-b9e7-a4eec683af3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.712933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1105886b-631f-4f7a-b9e7-a4eec683af3e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:36.723964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105886b-631f-4f7a-b9e7-a4eec683af3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:36.725348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105886b-631f-4f7a-b9e7-a4eec683af3e service glance] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:36.726454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1336/2699] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:36:36 2022] DELETE /identity/v3/users/f0fad81c4cbd4335967e97fd7de9963d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:36:36.734399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1364/2700] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:36:36.901072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:36.902639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:36.976372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13616f-2487-4377-b6e9-e7907a0ef377 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:36.981707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:36.982871 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:36.983280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:36.983669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] PATH_INFO: `/v3/projects/8b482c4c00e94a25ad8f0a9034e9e0e5` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:36.985110 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b482c4c00e94a25ad8f0a9034e9e0e5)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:36.987031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:37.034352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'request_id': 'req-129b2844-c963-4974-a29d-287c7a587cce'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:37.041884 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'request_id': 'req-129b2844-c963-4974-a29d-287c7a587cce'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:37.049852 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b482c4c00e94a25ad8f0a9034e9e0e5', 'request_id': 'req-129b2844-c963-4974-a29d-287c7a587cce'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:37.063939 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] The token cache is being invalidate because project 8b482c4c00e94a25ad8f0a9034e9e0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:36:37.064295 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:37.065121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-129b2844-c963-4974-a29d-287c7a587cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:37.066785 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1337/2701] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:36:36 2022] DELETE /identity/v3/projects/8b482c4c00e94a25ad8f0a9034e9e0e5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:37.072459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93083-0b4f-4be2-b4f6-5b8e75573cac None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.073514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93083-0b4f-4be2-b4f6-5b8e75573cac None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.073868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a93083-0b4f-4be2-b4f6-5b8e75573cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.096727 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-23a93083-0b4f-4be2-b4f6-5b8e75573cac None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:37.098010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-23a93083-0b4f-4be2-b4f6-5b8e75573cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:37.154397 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b1b48-5cc8-4a1f-b2b0-6c488c77222d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.154696 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b1b48-5cc8-4a1f-b2b0-6c488c77222d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.155645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b1b48-5cc8-4a1f-b2b0-6c488c77222d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.166162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1365/2702] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:37.174764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326a9dd-3c72-43f1-9582-2599e291982a None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.175318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326a9dd-3c72-43f1-9582-2599e291982a None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.175442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e52b1b48-5cc8-4a1f-b2b0-6c488c77222d None None] MFA Rules not processed for user `3b1d212dad5347a888832a779beadece`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:37.175862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326a9dd-3c72-43f1-9582-2599e291982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.176656 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e52b1b48-5cc8-4a1f-b2b0-6c488c77222d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:37.204868 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-1326a9dd-3c72-43f1-9582-2599e291982a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:37.206464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1326a9dd-3c72-43f1-9582-2599e291982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:37.219056 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1366/2703] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:37.220021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326a9dd-3c72-43f1-9582-2599e291982a None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:37.229670 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326a9dd-3c72-43f1-9582-2599e291982a None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:37.235259 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7f3c9-32b3-4056-b712-fdc1086a71de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:37.236029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7f3c9-32b3-4056-b712-fdc1086a71de admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.236410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7f3c9-32b3-4056-b712-fdc1086a71de admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.236785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7f3c9-32b3-4056-b712-fdc1086a71de admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.237614 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7f3c9-32b3-4056-b712-fdc1086a71de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:36:37.238129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7f3c9-32b3-4056-b712-fdc1086a71de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:37.239826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7f3c9-32b3-4056-b712-fdc1086a71de admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:37.251867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1338/2704] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:36:37.252633 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1367/2705] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:36:37.257211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b1b48-5cc8-4a1f-b2b0-6c488c77222d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:37.268486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b1b48-5cc8-4a1f-b2b0-6c488c77222d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:37.273022 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4ba6d-8ac3-416e-be2b-eb2727d4a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:37.273671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4ba6d-8ac3-416e-be2b-eb2727d4a3f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.273957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4ba6d-8ac3-416e-be2b-eb2727d4a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.274230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4ba6d-8ac3-416e-be2b-eb2727d4a3f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.274944 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4ba6d-8ac3-416e-be2b-eb2727d4a3f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:37.276813 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4ba6d-8ac3-416e-be2b-eb2727d4a3f7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:37.302300 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1339/2706] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:36:37 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:37.306157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7f3c9-32b3-4056-b712-fdc1086a71de admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:37.316247 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7f3c9-32b3-4056-b712-fdc1086a71de admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:37.376781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f2670-d8f5-4904-970e-7f792052624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:37.377451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f2670-d8f5-4904-970e-7f792052624a admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.377735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f2670-d8f5-4904-970e-7f792052624a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.378099 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f2670-d8f5-4904-970e-7f792052624a admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.378710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f2670-d8f5-4904-970e-7f792052624a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:37.380854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f2670-d8f5-4904-970e-7f792052624a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:37.402444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1368/2707] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:36:37 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:36:37.406990 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4ba6d-8ac3-416e-be2b-eb2727d4a3f7 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:37.417079 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4ba6d-8ac3-416e-be2b-eb2727d4a3f7 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:37.422425 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3146c-4143-4fa7-8550-4f8de726a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:37.423096 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3146c-4143-4fa7-8550-4f8de726a7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.423377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3146c-4143-4fa7-8550-4f8de726a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.423657 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3146c-4143-4fa7-8550-4f8de726a7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.424408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3146c-4143-4fa7-8550-4f8de726a7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:37.426015 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3146c-4143-4fa7-8550-4f8de726a7f4 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:37.437319 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1340/2708] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:37.442272 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f2670-d8f5-4904-970e-7f792052624a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:37.452542 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f2670-d8f5-4904-970e-7f792052624a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:37.457514 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264167ad-647c-4a86-aa2f-2650e634154a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:37.458364 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264167ad-647c-4a86-aa2f-2650e634154a admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.458720 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264167ad-647c-4a86-aa2f-2650e634154a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.459026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264167ad-647c-4a86-aa2f-2650e634154a admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.459784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264167ad-647c-4a86-aa2f-2650e634154a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:37.461411 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264167ad-647c-4a86-aa2f-2650e634154a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:37.472226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1369/2709] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:36:37.476593 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3146c-4143-4fa7-8550-4f8de726a7f4 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:37.486962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3146c-4143-4fa7-8550-4f8de726a7f4 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:37.495453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447c954-1812-432b-9071-3520560319d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:37.496341 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c954-1812-432b-9071-3520560319d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.496621 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c954-1812-432b-9071-3520560319d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.496895 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1447c954-1812-432b-9071-3520560319d6 admin admin] PATH_INFO: `/v3/projects/add150d29f3d4ccc8d4e3775577e3d57/users/69f5eaf4727f4bbf84ce10a5e07d582e/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.512276 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447c954-1812-432b-9071-3520560319d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=add150d29f3d4ccc8d4e3775577e3d57, user_id=69f5eaf4727f4bbf84ce10a5e07d582e, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:37.515945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1447c954-1812-432b-9071-3520560319d6 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:37.534350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1341/2710] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:36:37 2022] PUT /identity/v3/projects/add150d29f3d4ccc8d4e3775577e3d57/users/69f5eaf4727f4bbf84ce10a5e07d582e/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:36:37.539925 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479d8b-7cd4-4b9a-b522-dc8b73876896 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.540508 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479d8b-7cd4-4b9a-b522-dc8b73876896 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.540959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479d8b-7cd4-4b9a-b522-dc8b73876896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.559267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d6479d8b-7cd4-4b9a-b522-dc8b73876896 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:37.560647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d6479d8b-7cd4-4b9a-b522-dc8b73876896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:37.652885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1370/2711] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:37.663876 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447c954-1812-432b-9071-3520560319d6 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:37.667263 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-1447c954-1812-432b-9071-3520560319d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:37.726761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1447c954-1812-432b-9071-3520560319d6 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:37.731376 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dde8ad-452d-47d1-808d-826c38b344ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:37.732200 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dde8ad-452d-47d1-808d-826c38b344ae service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:37.732583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dde8ad-452d-47d1-808d-826c38b344ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:37.732979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dde8ad-452d-47d1-808d-826c38b344ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:37.745071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dde8ad-452d-47d1-808d-826c38b344ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:37.746550 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dde8ad-452d-47d1-808d-826c38b344ae service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:37.756692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1342/2712] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:40.238487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6479d8b-7cd4-4b9a-b522-dc8b73876896 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:40.257389 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6479d8b-7cd4-4b9a-b522-dc8b73876896 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:40.261449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:40.262564 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:40.262859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:40.263155 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:40.266169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:40.278586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:40.280103 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:40.298538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1371/2713] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:42.661008 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652360aa-a14d-4cd9-a54d-d6acf723de38 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:42.661557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652360aa-a14d-4cd9-a54d-d6acf723de38 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:42.661557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652360aa-a14d-4cd9-a54d-d6acf723de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:42.691031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-652360aa-a14d-4cd9-a54d-d6acf723de38 None None] MFA Rules not processed for user `69f5eaf4727f4bbf84ce10a5e07d582e`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:42.692369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-652360aa-a14d-4cd9-a54d-d6acf723de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:42.764184 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1343/2714] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:42.777112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:42.778574 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:42.854625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab92509-6eb2-444f-8fdc-29632021682d service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:42.860333 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56004d1-5762-43e0-b51e-ad3fee77e310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:42.860838 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56004d1-5762-43e0-b51e-ad3fee77e310 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:42.861120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56004d1-5762-43e0-b51e-ad3fee77e310 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:42.861413 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56004d1-5762-43e0-b51e-ad3fee77e310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:42.871384 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56004d1-5762-43e0-b51e-ad3fee77e310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:42.873005 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56004d1-5762-43e0-b51e-ad3fee77e310 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:42.883348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1372/2715] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:36:44.734979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e694c-a20a-4f57-a074-fc1ab5dcb6aa None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:44.734979 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e694c-a20a-4f57-a074-fc1ab5dcb6aa None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:44.735468 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e694c-a20a-4f57-a074-fc1ab5dcb6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:44.757154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d37e694c-a20a-4f57-a074-fc1ab5dcb6aa None None] MFA Rules not processed for user `69f5eaf4727f4bbf84ce10a5e07d582e`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:44.758660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d37e694c-a20a-4f57-a074-fc1ab5dcb6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:44.766496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1344/2716] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:36:54.011607 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56004d1-5762-43e0-b51e-ad3fee77e310 service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:54.013345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b56004d1-5762-43e0-b51e-ad3fee77e310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:54.029344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56004d1-5762-43e0-b51e-ad3fee77e310 service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:54.034815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:54.035455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:54.035739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:54.036012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:54.037751 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:54.049677 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:54.051264 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:54.062284 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1373/2717] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:58.914511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e694c-a20a-4f57-a074-fc1ab5dcb6aa None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:58.924018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e694c-a20a-4f57-a074-fc1ab5dcb6aa None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:58.927588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69342074-326c-4ffe-a9e2-3c3b758c450d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:58.928222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342074-326c-4ffe-a9e2-3c3b758c450d service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:58.928510 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342074-326c-4ffe-a9e2-3c3b758c450d service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:58.928784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69342074-326c-4ffe-a9e2-3c3b758c450d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:58.930764 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-69342074-326c-4ffe-a9e2-3c3b758c450d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:58.995064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69342074-326c-4ffe-a9e2-3c3b758c450d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:58.996495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69342074-326c-4ffe-a9e2-3c3b758c450d service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:59.007545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1345/2718] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:36:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:36:59.800669 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:36:59.802097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:36:59.815660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2b33c-0f9a-4e96-8613-456df4db5296 service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:36:59.820177 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:36:59.821057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:59.821346 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:59.821620 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] PATH_INFO: `/v3/users/68041024e96942889244157e42139571` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:59.822826 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68041024e96942889244157e42139571)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:36:59.824723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:36:59.869420 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68041024e96942889244157e42139571'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:59.876969 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68041024e96942889244157e42139571'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:59.884785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68041024e96942889244157e42139571'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:59.885511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68041024e96942889244157e42139571'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:59.886112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68041024e96942889244157e42139571'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:36:59.903094 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1374/2719] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:36:59 2022] DELETE /identity/v3/users/68041024e96942889244157e42139571 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:36:59.908822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a8ed4-9680-48c5-8c51-5da7ea035234 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:36:59.909256 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a8ed4-9680-48c5-8c51-5da7ea035234 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:36:59.909602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a8ed4-9680-48c5-8c51-5da7ea035234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:36:59.928377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-298a8ed4-9680-48c5-8c51-5da7ea035234 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:36:59.929596 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-298a8ed4-9680-48c5-8c51-5da7ea035234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:00.001751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1346/2720] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:00.013266 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:00.014795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:00.075654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad06cd-e9d3-4c2b-b7b7-379b6609362a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:00.079428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2abf5-2de5-4c9e-9c18-b227f788d585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:00.080081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2abf5-2de5-4c9e-9c18-b227f788d585 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.080366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2abf5-2de5-4c9e-9c18-b227f788d585 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.080647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2abf5-2de5-4c9e-9c18-b227f788d585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.090142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2abf5-2de5-4c9e-9c18-b227f788d585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:00.091749 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc2abf5-2de5-4c9e-9c18-b227f788d585 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:00.102203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1375/2721] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:37:00.374845 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a8ed4-9680-48c5-8c51-5da7ea035234 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:00.376466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-298a8ed4-9680-48c5-8c51-5da7ea035234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:00.392833 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a8ed4-9680-48c5-8c51-5da7ea035234 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:00.398193 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:00.399428 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.399996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.400467 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] PATH_INFO: `/v3/projects/37952e8e9e8d4fca9cc271a3684025c0` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.402014 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37952e8e9e8d4fca9cc271a3684025c0)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:00.404159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:00.453293 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37952e8e9e8d4fca9cc271a3684025c0', 'request_id': 'req-3bd2c3c4-78ff-402d-b213-085927c4e290'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:00.459401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37952e8e9e8d4fca9cc271a3684025c0', 'request_id': 'req-3bd2c3c4-78ff-402d-b213-085927c4e290'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:00.465612 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37952e8e9e8d4fca9cc271a3684025c0', 'request_id': 'req-3bd2c3c4-78ff-402d-b213-085927c4e290'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:00.481192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] The token cache is being invalidate because project 37952e8e9e8d4fca9cc271a3684025c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:37:00.481781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:00.482446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-3bd2c3c4-78ff-402d-b213-085927c4e290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:00.484161 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1347/2722] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:37:00 2022] DELETE /identity/v3/projects/37952e8e9e8d4fca9cc271a3684025c0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:37:00.489304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33562922-72c5-42b6-9281-576b0424e192 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.489594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33562922-72c5-42b6-9281-576b0424e192 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.489874 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33562922-72c5-42b6-9281-576b0424e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.507172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-33562922-72c5-42b6-9281-576b0424e192 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:00.508373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-33562922-72c5-42b6-9281-576b0424e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:00.572962 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1376/2723] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:37:00.580610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49718ae3-6387-4f40-8561-fa1ef18602da None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.580934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49718ae3-6387-4f40-8561-fa1ef18602da None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.581239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49718ae3-6387-4f40-8561-fa1ef18602da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.600993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-49718ae3-6387-4f40-8561-fa1ef18602da None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:00.602307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-49718ae3-6387-4f40-8561-fa1ef18602da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:00.610872 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1348/2724] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:37:00.615162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33562922-72c5-42b6-9281-576b0424e192 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:00.625575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33562922-72c5-42b6-9281-576b0424e192 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:00.629998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc88e0-85b6-4c38-b8dc-904f0b65fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:00.630689 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc88e0-85b6-4c38-b8dc-904f0b65fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.630971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc88e0-85b6-4c38-b8dc-904f0b65fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.631245 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc88e0-85b6-4c38-b8dc-904f0b65fa78 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.631986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc88e0-85b6-4c38-b8dc-904f0b65fa78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:37:00.632287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc88e0-85b6-4c38-b8dc-904f0b65fa78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:00.633894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc88e0-85b6-4c38-b8dc-904f0b65fa78 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:00.648937 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1377/2725] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:37:00.653060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49718ae3-6387-4f40-8561-fa1ef18602da None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:00.665451 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49718ae3-6387-4f40-8561-fa1ef18602da None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:00.671760 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ce10a-db8c-44eb-9521-d5266e2e30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:00.672457 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce10a-db8c-44eb-9521-d5266e2e30f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.673675 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce10a-db8c-44eb-9521-d5266e2e30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.673960 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce10a-db8c-44eb-9521-d5266e2e30f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.674701 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ce10a-db8c-44eb-9521-d5266e2e30f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:00.676623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ce10a-db8c-44eb-9521-d5266e2e30f7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:00.707172 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1349/2726] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:37:00 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:37:00.708625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc88e0-85b6-4c38-b8dc-904f0b65fa78 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:00.720894 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc88e0-85b6-4c38-b8dc-904f0b65fa78 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:00.800047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59478df1-cf5d-4d92-a273-eca0c8340b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:00.800854 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59478df1-cf5d-4d92-a273-eca0c8340b19 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.801425 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59478df1-cf5d-4d92-a273-eca0c8340b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.801425 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59478df1-cf5d-4d92-a273-eca0c8340b19 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.802076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59478df1-cf5d-4d92-a273-eca0c8340b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:00.804154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59478df1-cf5d-4d92-a273-eca0c8340b19 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:00.828098 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1378/2727] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:37:00 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:37:00.829692 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ce10a-db8c-44eb-9521-d5266e2e30f7 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:00.841499 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ce10a-db8c-44eb-9521-d5266e2e30f7 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:00.848617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061dc3-bdf0-44e6-899c-ad6b2bb963ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:00.849394 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061dc3-bdf0-44e6-899c-ad6b2bb963ed admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.849764 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061dc3-bdf0-44e6-899c-ad6b2bb963ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.850126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061dc3-bdf0-44e6-899c-ad6b2bb963ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.850990 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66061dc3-bdf0-44e6-899c-ad6b2bb963ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:00.852745 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66061dc3-bdf0-44e6-899c-ad6b2bb963ed admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:00.871344 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1350/2728] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:37:00.874971 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59478df1-cf5d-4d92-a273-eca0c8340b19 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:00.888533 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59478df1-cf5d-4d92-a273-eca0c8340b19 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:00.895503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca709cc-b785-4021-97ff-aa2457a2385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:00.896534 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca709cc-b785-4021-97ff-aa2457a2385a admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.896991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca709cc-b785-4021-97ff-aa2457a2385a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.897429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca709cc-b785-4021-97ff-aa2457a2385a admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.898359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca709cc-b785-4021-97ff-aa2457a2385a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:00.900133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca709cc-b785-4021-97ff-aa2457a2385a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:00.915922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1379/2729] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:37:00.919989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061dc3-bdf0-44e6-899c-ad6b2bb963ed admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:00.932442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061dc3-bdf0-44e6-899c-ad6b2bb963ed admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:00.939466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c989f1-b4d1-4d7f-bf33-f8eeb2dcfcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:00.941153 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c989f1-b4d1-4d7f-bf33-f8eeb2dcfcc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.941444 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c989f1-b4d1-4d7f-bf33-f8eeb2dcfcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:00.941790 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c989f1-b4d1-4d7f-bf33-f8eeb2dcfcc0 admin admin] PATH_INFO: `/v3/projects/32ecad9dfdde488cb168e1043f483093/users/6f3f43c9fc6d4981badf3e7d3b827f92/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:00.968591 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c989f1-b4d1-4d7f-bf33-f8eeb2dcfcc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ecad9dfdde488cb168e1043f483093, user_id=6f3f43c9fc6d4981badf3e7d3b827f92, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:00.971372 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c989f1-b4d1-4d7f-bf33-f8eeb2dcfcc0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:00.987033 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1351/2730] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:37:00 2022] PUT /identity/v3/projects/32ecad9dfdde488cb168e1043f483093/users/6f3f43c9fc6d4981badf3e7d3b827f92/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:37:00.998851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf92a7-ae7c-414a-819d-1220d2ac2880 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:00.999951 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf92a7-ae7c-414a-819d-1220d2ac2880 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:01.000232 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf92a7-ae7c-414a-819d-1220d2ac2880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:01.031909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-9ebf92a7-ae7c-414a-819d-1220d2ac2880 None None] MFA Rules not processed for user `6f3f43c9fc6d4981badf3e7d3b827f92`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:01.033336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9ebf92a7-ae7c-414a-819d-1220d2ac2880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:01.103431 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1380/2731] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:01.114607 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c989f1-b4d1-4d7f-bf33-f8eeb2dcfcc0 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:01.116342 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d1c989f1-b4d1-4d7f-bf33-f8eeb2dcfcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:01.179017 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c989f1-b4d1-4d7f-bf33-f8eeb2dcfcc0 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:01.183139 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65888ac-9b4f-43d4-b51c-cdf91d47ae08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:01.183989 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65888ac-9b4f-43d4-b51c-cdf91d47ae08 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:01.184465 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65888ac-9b4f-43d4-b51c-cdf91d47ae08 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:01.184907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65888ac-9b4f-43d4-b51c-cdf91d47ae08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:01.195600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65888ac-9b4f-43d4-b51c-cdf91d47ae08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:01.197557 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65888ac-9b4f-43d4-b51c-cdf91d47ae08 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:01.209173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1352/2732] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:37:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:37:02.974344 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf92a7-ae7c-414a-819d-1220d2ac2880 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:02.975881 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9ebf92a7-ae7c-414a-819d-1220d2ac2880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:03.046697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf92a7-ae7c-414a-819d-1220d2ac2880 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:03.052006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bda5c-cc95-4ad6-97db-50fc8f8ee579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:03.052657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bda5c-cc95-4ad6-97db-50fc8f8ee579 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:03.052940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bda5c-cc95-4ad6-97db-50fc8f8ee579 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:03.053218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bda5c-cc95-4ad6-97db-50fc8f8ee579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:03.054964 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bb4bda5c-cc95-4ad6-97db-50fc8f8ee579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:03.067503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bda5c-cc95-4ad6-97db-50fc8f8ee579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:03.069069 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bda5c-cc95-4ad6-97db-50fc8f8ee579 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:03.079484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1381/2733] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:37:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:37:24.432209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65888ac-9b4f-43d4-b51c-cdf91d47ae08 service cinder] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:24.493816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65888ac-9b4f-43d4-b51c-cdf91d47ae08 service cinder] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:24.498302 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:24.499703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:24.499982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:24.500258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] PATH_INFO: `/v3/users/6f3f43c9fc6d4981badf3e7d3b827f92` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:24.501435 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3f43c9fc6d4981badf3e7d3b827f92)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:24.503409 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:24.546633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3f43c9fc6d4981badf3e7d3b827f92'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:24.553078 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3f43c9fc6d4981badf3e7d3b827f92'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:24.559665 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3f43c9fc6d4981badf3e7d3b827f92'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:24.560290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3f43c9fc6d4981badf3e7d3b827f92'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:24.560881 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3f43c9fc6d4981badf3e7d3b827f92'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:24.577752 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1353/2734] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:37:24 2022] DELETE /identity/v3/users/6f3f43c9fc6d4981badf3e7d3b827f92 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:37:24.582458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435222b-3a31-4943-93bc-9f783cb96437 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:24.582959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435222b-3a31-4943-93bc-9f783cb96437 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:24.583073 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435222b-3a31-4943-93bc-9f783cb96437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:24.600029 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0435222b-3a31-4943-93bc-9f783cb96437 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:24.601213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0435222b-3a31-4943-93bc-9f783cb96437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:24.657015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1382/2735] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:24.666871 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:24.668263 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:24.723442 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcb077-b0d3-44d1-b998-d8ce12d6acf6 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:24.727040 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1695f-53e8-4886-9cab-65ad133c6a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:24.727674 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1695f-53e8-4886-9cab-65ad133c6a6f service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:24.727957 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1695f-53e8-4886-9cab-65ad133c6a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:24.728229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1695f-53e8-4886-9cab-65ad133c6a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:24.737488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1695f-53e8-4886-9cab-65ad133c6a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:24.738929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1695f-53e8-4886-9cab-65ad133c6a6f service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:24.748330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1354/2736] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:37:25.001917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435222b-3a31-4943-93bc-9f783cb96437 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:25.003359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0435222b-3a31-4943-93bc-9f783cb96437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:25.015901 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435222b-3a31-4943-93bc-9f783cb96437 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:25.020478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:25.021331 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.021613 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.021890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] PATH_INFO: `/v3/projects/32ecad9dfdde488cb168e1043f483093` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.023133 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ecad9dfdde488cb168e1043f483093)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:25.025020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:25.070399 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ecad9dfdde488cb168e1043f483093', 'request_id': 'req-222b9e10-cf62-4f23-901d-5ea5f9022191'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:25.076410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ecad9dfdde488cb168e1043f483093', 'request_id': 'req-222b9e10-cf62-4f23-901d-5ea5f9022191'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:25.083567 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ecad9dfdde488cb168e1043f483093', 'request_id': 'req-222b9e10-cf62-4f23-901d-5ea5f9022191'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:25.093506 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] The token cache is being invalidate because project 32ecad9dfdde488cb168e1043f483093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:37:25.093792 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:25.094475 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-222b9e10-cf62-4f23-901d-5ea5f9022191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:37:25.095998 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1383/2737] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:37:25 2022] DELETE /identity/v3/projects/32ecad9dfdde488cb168e1043f483093 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:37:25.101605 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef545268-c4e7-47c1-87f8-6b156f1c48e5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.101892 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef545268-c4e7-47c1-87f8-6b156f1c48e5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.102164 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef545268-c4e7-47c1-87f8-6b156f1c48e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.119829 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-ef545268-c4e7-47c1-87f8-6b156f1c48e5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:25.121011 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-ef545268-c4e7-47c1-87f8-6b156f1c48e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:25.177159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1355/2738] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:25.185068 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eab83-99bc-4d5a-8396-fdc714f71941 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.185360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eab83-99bc-4d5a-8396-fdc714f71941 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.185639 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5eab83-99bc-4d5a-8396-fdc714f71941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.203820 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-6e5eab83-99bc-4d5a-8396-fdc714f71941 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:25.204974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-6e5eab83-99bc-4d5a-8396-fdc714f71941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:25.212648 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1384/2739] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:25.216579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef545268-c4e7-47c1-87f8-6b156f1c48e5 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:25.225890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef545268-c4e7-47c1-87f8-6b156f1c48e5 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:25.230477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31702003-0afa-442a-91f0-8de7d7644c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:25.231120 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31702003-0afa-442a-91f0-8de7d7644c6a admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.231401 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31702003-0afa-442a-91f0-8de7d7644c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.231677 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31702003-0afa-442a-91f0-8de7d7644c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.232395 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31702003-0afa-442a-91f0-8de7d7644c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:37:25.232699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31702003-0afa-442a-91f0-8de7d7644c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:25.234859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31702003-0afa-442a-91f0-8de7d7644c6a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:25.245842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1356/2740] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:37:25.250515 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eab83-99bc-4d5a-8396-fdc714f71941 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:25.259303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5eab83-99bc-4d5a-8396-fdc714f71941 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:25.263833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499137b-d434-42fd-97f9-2fee1c681026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:25.264494 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499137b-d434-42fd-97f9-2fee1c681026 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.264776 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499137b-d434-42fd-97f9-2fee1c681026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.265053 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499137b-d434-42fd-97f9-2fee1c681026 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.265992 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499137b-d434-42fd-97f9-2fee1c681026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:25.267909 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499137b-d434-42fd-97f9-2fee1c681026 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:25.292174 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1385/2741] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:37:25 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:37:25.296812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31702003-0afa-442a-91f0-8de7d7644c6a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:25.306503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31702003-0afa-442a-91f0-8de7d7644c6a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:25.359497 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066d9b5-3806-4a9a-b1d3-8d7b8a59be4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:25.360152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066d9b5-3806-4a9a-b1d3-8d7b8a59be4f admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.360437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066d9b5-3806-4a9a-b1d3-8d7b8a59be4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.360713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066d9b5-3806-4a9a-b1d3-8d7b8a59be4f admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.361378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066d9b5-3806-4a9a-b1d3-8d7b8a59be4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:25.363291 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066d9b5-3806-4a9a-b1d3-8d7b8a59be4f admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:25.381817 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1357/2742] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:37:25 2022] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:37:25.386026 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499137b-d434-42fd-97f9-2fee1c681026 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:25.396741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499137b-d434-42fd-97f9-2fee1c681026 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:25.401172 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad94bd4-22b2-4dec-a23e-de66806e53d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:25.401817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad94bd4-22b2-4dec-a23e-de66806e53d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.402097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad94bd4-22b2-4dec-a23e-de66806e53d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.402406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad94bd4-22b2-4dec-a23e-de66806e53d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.403143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad94bd4-22b2-4dec-a23e-de66806e53d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:25.404712 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad94bd4-22b2-4dec-a23e-de66806e53d8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:25.414518 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1386/2743] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:37:25.418230 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066d9b5-3806-4a9a-b1d3-8d7b8a59be4f admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:25.428280 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066d9b5-3806-4a9a-b1d3-8d7b8a59be4f admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:25.432768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e630a-82e0-4c8a-9af3-052fe0991285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:25.433405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e630a-82e0-4c8a-9af3-052fe0991285 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.433686 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e630a-82e0-4c8a-9af3-052fe0991285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.433961 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e630a-82e0-4c8a-9af3-052fe0991285 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.434699 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e630a-82e0-4c8a-9af3-052fe0991285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:25.436895 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e630a-82e0-4c8a-9af3-052fe0991285 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:25.446349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1358/2744] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:37:25.450627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad94bd4-22b2-4dec-a23e-de66806e53d8 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:25.461007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad94bd4-22b2-4dec-a23e-de66806e53d8 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:25.465682 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabf4e0-53bf-45b0-a1f2-8b3b6cd40f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:25.466594 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabf4e0-53bf-45b0-a1f2-8b3b6cd40f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.466905 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabf4e0-53bf-45b0-a1f2-8b3b6cd40f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.467207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabf4e0-53bf-45b0-a1f2-8b3b6cd40f70 admin admin] PATH_INFO: `/v3/projects/ba38491d23d64bd58eabf7ea16fd68e8/users/fea857a427b0464daf88491b3d4ecbc3/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.481323 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabf4e0-53bf-45b0-a1f2-8b3b6cd40f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba38491d23d64bd58eabf7ea16fd68e8, user_id=fea857a427b0464daf88491b3d4ecbc3, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:25.483982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabf4e0-53bf-45b0-a1f2-8b3b6cd40f70 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:25.495917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1387/2745] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:37:25 2022] PUT /identity/v3/projects/ba38491d23d64bd58eabf7ea16fd68e8/users/fea857a427b0464daf88491b3d4ecbc3/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:37:25.501294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350c215-be25-4302-b535-d952d90bd6e8 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.501618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350c215-be25-4302-b535-d952d90bd6e8 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.501905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350c215-be25-4302-b535-d952d90bd6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.519718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-a350c215-be25-4302-b535-d952d90bd6e8 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:25.520896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a350c215-be25-4302-b535-d952d90bd6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:25.576301 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1359/2746] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:25.585731 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabf4e0-53bf-45b0-a1f2-8b3b6cd40f70 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:25.587554 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7eabf4e0-53bf-45b0-a1f2-8b3b6cd40f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:25.641566 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabf4e0-53bf-45b0-a1f2-8b3b6cd40f70 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:25.645130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6adc7-8945-4fce-a526-c4b8f8970778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:25.645767 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6adc7-8945-4fce-a526-c4b8f8970778 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:25.646050 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6adc7-8945-4fce-a526-c4b8f8970778 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:25.646351 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6adc7-8945-4fce-a526-c4b8f8970778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:25.655603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6adc7-8945-4fce-a526-c4b8f8970778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:25.657013 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6adc7-8945-4fce-a526-c4b8f8970778 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:25.667176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1388/2747] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:37:29.834388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd2f6-8b0d-4642-b5ad-bf50bf93e001 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:29.834947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd2f6-8b0d-4642-b5ad-bf50bf93e001 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:29.834947 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd2f6-8b0d-4642-b5ad-bf50bf93e001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:29.866865 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-9fefd2f6-8b0d-4642-b5ad-bf50bf93e001 None None] MFA Rules not processed for user `fea857a427b0464daf88491b3d4ecbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:29.871670 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9fefd2f6-8b0d-4642-b5ad-bf50bf93e001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:29.948456 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1360/2748] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:29.953318 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6adc7-8945-4fce-a526-c4b8f8970778 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:29.963435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6adc7-8945-4fce-a526-c4b8f8970778 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:29.968526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c712e1-dbcc-4e89-9b58-e680cbf20c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:29.969184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c712e1-dbcc-4e89-9b58-e680cbf20c2e admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:29.969467 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c712e1-dbcc-4e89-9b58-e680cbf20c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:29.969741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c712e1-dbcc-4e89-9b58-e680cbf20c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:29.970451 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c712e1-dbcc-4e89-9b58-e680cbf20c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:29.972603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c712e1-dbcc-4e89-9b58-e680cbf20c2e admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:30.001471 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1389/2749] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:37:29 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:37:30.005899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefd2f6-8b0d-4642-b5ad-bf50bf93e001 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:30.019642 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefd2f6-8b0d-4642-b5ad-bf50bf93e001 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:30.084053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919b71c-e7ab-43da-bb20-f1ace0400f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:30.084728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919b71c-e7ab-43da-bb20-f1ace0400f33 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:30.085014 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919b71c-e7ab-43da-bb20-f1ace0400f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:30.085422 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919b71c-e7ab-43da-bb20-f1ace0400f33 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:30.105056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919b71c-e7ab-43da-bb20-f1ace0400f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:30.105056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919b71c-e7ab-43da-bb20-f1ace0400f33 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:30.114555 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1361/2750] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:37:30 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:37:30.118601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c712e1-dbcc-4e89-9b58-e680cbf20c2e admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:30.129162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c712e1-dbcc-4e89-9b58-e680cbf20c2e admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:30.133733 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e762802-cdd9-4a9e-9c83-0dec178bc9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:30.134423 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e762802-cdd9-4a9e-9c83-0dec178bc9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:30.134714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e762802-cdd9-4a9e-9c83-0dec178bc9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:30.134993 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e762802-cdd9-4a9e-9c83-0dec178bc9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:30.135710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e762802-cdd9-4a9e-9c83-0dec178bc9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:30.137293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e762802-cdd9-4a9e-9c83-0dec178bc9b8 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:30.148316 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1390/2751] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:37:30.152421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919b71c-e7ab-43da-bb20-f1ace0400f33 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:30.162430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919b71c-e7ab-43da-bb20-f1ace0400f33 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:30.167024 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de9e24-05f1-4f6f-8f45-171156b5aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:30.167916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de9e24-05f1-4f6f-8f45-171156b5aaee admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:30.168192 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de9e24-05f1-4f6f-8f45-171156b5aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:30.168462 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de9e24-05f1-4f6f-8f45-171156b5aaee admin admin] PATH_INFO: `/v3/projects/6919b51b902c42c29f2262d0515f56ac/users/af3855f204384d6f86b6a13baa329cd8/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:30.182810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de9e24-05f1-4f6f-8f45-171156b5aaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=6919b51b902c42c29f2262d0515f56ac, user_id=af3855f204384d6f86b6a13baa329cd8, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:30.185531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de9e24-05f1-4f6f-8f45-171156b5aaee admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:30.198396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1362/2752] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:37:30 2022] PUT /identity/v3/projects/6919b51b902c42c29f2262d0515f56ac/users/af3855f204384d6f86b6a13baa329cd8/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:37:30.203063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e762802-cdd9-4a9e-9c83-0dec178bc9b8 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:30.212766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e762802-cdd9-4a9e-9c83-0dec178bc9b8 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:30.268024 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6d12f-a464-4ce1-b1f4-56f60fce5c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:30.268693 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6d12f-a464-4ce1-b1f4-56f60fce5c56 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:30.268979 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6d12f-a464-4ce1-b1f4-56f60fce5c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:30.269254 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6d12f-a464-4ce1-b1f4-56f60fce5c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:30.269975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6d12f-a464-4ce1-b1f4-56f60fce5c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:30.271580 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6d12f-a464-4ce1-b1f4-56f60fce5c56 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:30.280974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1391/2753] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:37:30.285121 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de9e24-05f1-4f6f-8f45-171156b5aaee admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:30.295031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de9e24-05f1-4f6f-8f45-171156b5aaee admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:30.300086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2c4ed-ad36-4648-a392-6fd66e4dae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:30.300952 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2c4ed-ad36-4648-a392-6fd66e4dae8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:30.301228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2c4ed-ad36-4648-a392-6fd66e4dae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:30.301495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2c4ed-ad36-4648-a392-6fd66e4dae8d admin admin] PATH_INFO: `/v3/projects/6919b51b902c42c29f2262d0515f56ac/users/af3855f204384d6f86b6a13baa329cd8/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:30.303473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2c4ed-ad36-4648-a392-6fd66e4dae8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6919b51b902c42c29f2262d0515f56ac, user_id=af3855f204384d6f86b6a13baa329cd8, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:30.306075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2c4ed-ad36-4648-a392-6fd66e4dae8d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:30.316511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1363/2754] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:37:30 2022] PUT /identity/v3/projects/6919b51b902c42c29f2262d0515f56ac/users/af3855f204384d6f86b6a13baa329cd8/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:37:34.791819 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a5732-6043-4ec4-a1d5-3ee7dbd472d4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:34.792329 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a5732-6043-4ec4-a1d5-3ee7dbd472d4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:34.792449 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a5732-6043-4ec4-a1d5-3ee7dbd472d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:34.820241 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-4b4a5732-6043-4ec4-a1d5-3ee7dbd472d4 None None] MFA Rules not processed for user `af3855f204384d6f86b6a13baa329cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:34.821439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4b4a5732-6043-4ec4-a1d5-3ee7dbd472d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:34.894280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1392/2755] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:34.906540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2c4ed-ad36-4648-a392-6fd66e4dae8d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:34.908364 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-26a2c4ed-ad36-4648-a392-6fd66e4dae8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:34.967836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2c4ed-ad36-4648-a392-6fd66e4dae8d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:34.971615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406d06e-de5e-41af-8692-a26f0fcbb948 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaf01f45e7a429e9361eb176a3f7c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:34.972346 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d06e-de5e-41af-8692-a26f0fcbb948 service glance] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:34.972658 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d06e-de5e-41af-8692-a26f0fcbb948 service glance] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:34.972963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406d06e-de5e-41af-8692-a26f0fcbb948 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:35.031176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406d06e-de5e-41af-8692-a26f0fcbb948 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:35.032654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406d06e-de5e-41af-8692-a26f0fcbb948 service glance] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:35.041888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1364/2756] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:37:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:37:35.141603 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefc418-76c8-4dc1-b047-25883036a527 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:35.141895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefc418-76c8-4dc1-b047-25883036a527 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:35.142175 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefc418-76c8-4dc1-b047-25883036a527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:35.160519 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-8fefc418-76c8-4dc1-b047-25883036a527 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:35.161710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-8fefc418-76c8-4dc1-b047-25883036a527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:35.219947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1393/2757] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:37:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:35.271856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406d06e-de5e-41af-8692-a26f0fcbb948 service glance] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:35.273270 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c406d06e-de5e-41af-8692-a26f0fcbb948 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:35.339208 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406d06e-de5e-41af-8692-a26f0fcbb948 service glance] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:35.344671 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb86e6-c815-4f53-a691-5dda83b60268 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:35.345308 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb86e6-c815-4f53-a691-5dda83b60268 service swift] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:35.345592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb86e6-c815-4f53-a691-5dda83b60268 service swift] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:35.345870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb86e6-c815-4f53-a691-5dda83b60268 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:35.353644 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb86e6-c815-4f53-a691-5dda83b60268 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:35.355238 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb86e6-c815-4f53-a691-5dda83b60268 service swift] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:35.363137 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1365/2758] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:37:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:37:43.892618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34799718-4f78-498f-881a-eb541f7980ee None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:43.893114 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34799718-4f78-498f-881a-eb541f7980ee None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:43.893213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34799718-4f78-498f-881a-eb541f7980ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:43.910240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-34799718-4f78-498f-881a-eb541f7980ee None None] MFA Rules not processed for user `fea857a427b0464daf88491b3d4ecbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:43.911455 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-34799718-4f78-498f-881a-eb541f7980ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:43.918146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1394/2759] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:37:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:44.164050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb86e6-c815-4f53-a691-5dda83b60268 service swift] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:44.215812 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb86e6-c815-4f53-a691-5dda83b60268 service swift] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:44.219954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e2da-1e50-43e7-b7bb-6bfb32e25bb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:44.220586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e2da-1e50-43e7-b7bb-6bfb32e25bb1 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:44.220870 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e2da-1e50-43e7-b7bb-6bfb32e25bb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:44.221147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e2da-1e50-43e7-b7bb-6bfb32e25bb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:44.223034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-16d2e2da-1e50-43e7-b7bb-6bfb32e25bb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:44.232289 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2e2da-1e50-43e7-b7bb-6bfb32e25bb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:44.234368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2e2da-1e50-43e7-b7bb-6bfb32e25bb1 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:44.242112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1366/2760] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:37:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:37:44.542766 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34799718-4f78-498f-881a-eb541f7980ee None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:44.544145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-34799718-4f78-498f-881a-eb541f7980ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:44.612405 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34799718-4f78-498f-881a-eb541f7980ee None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:44.617775 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9841ab3-f246-43f2-a854-6d863522d1c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92588782f32a472193340aba2bff8d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:44.618427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9841ab3-f246-43f2-a854-6d863522d1c8 service placement] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:44.618716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9841ab3-f246-43f2-a854-6d863522d1c8 service placement] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:44.618988 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9841ab3-f246-43f2-a854-6d863522d1c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:44.620955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a9841ab3-f246-43f2-a854-6d863522d1c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:44.632650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9841ab3-f246-43f2-a854-6d863522d1c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:44.634278 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9841ab3-f246-43f2-a854-6d863522d1c8 service placement] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:44.644880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1395/2761] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:37:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:37:45.922212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d2f8d-8238-4b84-85eb-bf980659a920 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:45.922738 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d2f8d-8238-4b84-85eb-bf980659a920 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:45.922836 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d2f8d-8238-4b84-85eb-bf980659a920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:45.940268 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-4d0d2f8d-8238-4b84-85eb-bf980659a920 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:37:45.941483 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4d0d2f8d-8238-4b84-85eb-bf980659a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:37:45.948719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1367/2762] 10.222.0.32 () {58 vars in 1009 bytes} [Tue Apr 12 00:37:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:37:45.962113 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9841ab3-f246-43f2-a854-6d863522d1c8 service placement] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:37:45.973438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9841ab3-f246-43f2-a854-6d863522d1c8 service placement] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:37:45.978508 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6889b81-94f5-4799-b0c5-029868a1477d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:37:45.979163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6889b81-94f5-4799-b0c5-029868a1477d service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:37:45.979434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6889b81-94f5-4799-b0c5-029868a1477d service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:37:45.979711 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6889b81-94f5-4799-b0c5-029868a1477d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:37:45.988620 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6889b81-94f5-4799-b0c5-029868a1477d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:37:45.990232 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6889b81-94f5-4799-b0c5-029868a1477d service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:37:45.998337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1396/2763] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:37:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:38:00.109133 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d2f8d-8238-4b84-85eb-bf980659a920 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:38:00.111661 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-4d0d2f8d-8238-4b84-85eb-bf980659a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:38:00.213985 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d2f8d-8238-4b84-85eb-bf980659a920 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:38:00.220146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431f66-19f1-45d4-aaec-eb36b62b5ca9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:38:00.220803 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431f66-19f1-45d4-aaec-eb36b62b5ca9 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:38:00.221087 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431f66-19f1-45d4-aaec-eb36b62b5ca9 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:38:00.221365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431f66-19f1-45d4-aaec-eb36b62b5ca9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:38:00.223400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-20431f66-19f1-45d4-aaec-eb36b62b5ca9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:38:00.236006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431f66-19f1-45d4-aaec-eb36b62b5ca9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:38:00.237610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431f66-19f1-45d4-aaec-eb36b62b5ca9 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:38:00.250005 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1368/2764] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:38:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:38:18.274236 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6889b81-94f5-4799-b0c5-029868a1477d service swift] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:38:18.283656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6889b81-94f5-4799-b0c5-029868a1477d service swift] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:38:18.287221 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606d824-65ae-4c74-b91d-aedfb62eb978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:38:18.287855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606d824-65ae-4c74-b91d-aedfb62eb978 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:38:18.288139 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606d824-65ae-4c74-b91d-aedfb62eb978 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:38:18.288415 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606d824-65ae-4c74-b91d-aedfb62eb978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:38:18.297984 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606d824-65ae-4c74-b91d-aedfb62eb978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:38:18.299538 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606d824-65ae-4c74-b91d-aedfb62eb978 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:38:18.308949 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1397/2765] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:38:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:38:43.129871 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc160f3-0adf-4209-8e52-086df8321660 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:38:43.130486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc160f3-0adf-4209-8e52-086df8321660 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:38:43.130486 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc160f3-0adf-4209-8e52-086df8321660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:38:43.158134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-bcc160f3-0adf-4209-8e52-086df8321660 None None] MFA Rules not processed for user `69f5eaf4727f4bbf84ce10a5e07d582e`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:38:43.159337 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bcc160f3-0adf-4209-8e52-086df8321660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:38:43.233355 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1369/2766] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:38:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:39:07.504325 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606d824-65ae-4c74-b91d-aedfb62eb978 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:39:07.561116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606d824-65ae-4c74-b91d-aedfb62eb978 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:39:07.566108 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92588782f32a472193340aba2bff8d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:39:07.566785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:39:07.567065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:39:07.567340 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:39:07.569210 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:39:07.591492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:39:07.593058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:39:07.603269 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1398/2767] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:39:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:39:16.304365 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc160f3-0adf-4209-8e52-086df8321660 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:39:16.305712 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bcc160f3-0adf-4209-8e52-086df8321660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:39:16.337897 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc160f3-0adf-4209-8e52-086df8321660 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:39:16.342099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4980c-bffc-4007-8b1f-0ebaaf20f301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:39:16.342756 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4980c-bffc-4007-8b1f-0ebaaf20f301 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:39:16.343034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4980c-bffc-4007-8b1f-0ebaaf20f301 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:39:16.343306 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4980c-bffc-4007-8b1f-0ebaaf20f301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:39:16.345006 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-a1e4980c-bffc-4007-8b1f-0ebaaf20f301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:39:16.425645 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4980c-bffc-4007-8b1f-0ebaaf20f301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:39:16.427098 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4980c-bffc-4007-8b1f-0ebaaf20f301 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:39:16.444728 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1370/2768] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:39:22.993401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:39:22.994934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:39:23.008041 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee337a6f-1148-4e42-9265-69d76737bbad service placement] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:39:23.014184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:39:23.015079 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:39:23.015629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:39:23.015919 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] PATH_INFO: `/v3/users/3b1d212dad5347a888832a779beadece` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:39:23.017067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1d212dad5347a888832a779beadece)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:39:23.018991 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:39:23.064427 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1d212dad5347a888832a779beadece'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.071997 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1d212dad5347a888832a779beadece'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.079947 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1d212dad5347a888832a779beadece'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.080828 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1d212dad5347a888832a779beadece'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.081513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1d212dad5347a888832a779beadece'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.099060 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1399/2769] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:39:22 2022] DELETE /identity/v3/users/3b1d212dad5347a888832a779beadece => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:39:23.336027 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4980c-bffc-4007-8b1f-0ebaaf20f301 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:39:23.347570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4980c-bffc-4007-8b1f-0ebaaf20f301 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:39:23.407768 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:39:23.408757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:39:23.409044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:39:23.409351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] PATH_INFO: `/v3/projects/4ad54dac63374c8a9b4da55ee5dc7fd1` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:39:23.410618 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad54dac63374c8a9b4da55ee5dc7fd1)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:39:23.412610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:39:23.459600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'request_id': 'req-c3df24fd-67c4-4305-8e59-1937b2ba3990'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.467025 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'request_id': 'req-c3df24fd-67c4-4305-8e59-1937b2ba3990'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.472197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad54dac63374c8a9b4da55ee5dc7fd1', 'request_id': 'req-c3df24fd-67c4-4305-8e59-1937b2ba3990'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.484057 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] The token cache is being invalidate because project 4ad54dac63374c8a9b4da55ee5dc7fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:39:23.484344 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.484964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.486569 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1371/2770] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:39:23 2022] DELETE /identity/v3/projects/4ad54dac63374c8a9b4da55ee5dc7fd1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:39:23.490558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:39:23.491934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:39:23.505252 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ae2f5-1c81-4e85-9703-0900d867202a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:39:23.561368 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:39:23.562230 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:39:23.562545 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:39:23.562817 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] PATH_INFO: `/v3/users/2ee3867006104ecaa42cbd7e2ad9aead` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:39:23.563986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee3867006104ecaa42cbd7e2ad9aead)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:39:23.565927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:39:23.609733 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee3867006104ecaa42cbd7e2ad9aead'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.616738 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee3867006104ecaa42cbd7e2ad9aead'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.624625 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee3867006104ecaa42cbd7e2ad9aead'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.625240 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee3867006104ecaa42cbd7e2ad9aead'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.625847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-c9b7610d-0b0f-408c-9114-17cf7765f05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee3867006104ecaa42cbd7e2ad9aead'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:23.643355 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1400/2771] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:39:23 2022] DELETE /identity/v3/users/2ee3867006104ecaa42cbd7e2ad9aead => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:39:23.896072 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:39:23.905505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:39:23.918071 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df24fd-67c4-4305-8e59-1937b2ba3990 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:39:23.972589 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:39:23.973351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:39:23.973633 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:39:23.973901 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] PATH_INFO: `/v3/projects/3de3a4084d864ba6845b0d8385e0b593` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:39:23.975158 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de3a4084d864ba6845b0d8385e0b593)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:39:23.977029 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:39:24.019719 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de3a4084d864ba6845b0d8385e0b593', 'request_id': 'req-75f345a3-7d0d-4c59-961c-790fdb7f8901'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:24.025528 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de3a4084d864ba6845b0d8385e0b593', 'request_id': 'req-75f345a3-7d0d-4c59-961c-790fdb7f8901'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:24.031207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de3a4084d864ba6845b0d8385e0b593', 'request_id': 'req-75f345a3-7d0d-4c59-961c-790fdb7f8901'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:24.042616 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] The token cache is being invalidate because project 3de3a4084d864ba6845b0d8385e0b593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:39:24.042899 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:24.044105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-75f345a3-7d0d-4c59-961c-790fdb7f8901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:39:24.045634 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1372/2772] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:39:23 2022] DELETE /identity/v3/projects/3de3a4084d864ba6845b0d8385e0b593 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:40:24.243842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eda835-3772-4c45-9d70-7153f4715160 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:40:24.244376 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eda835-3772-4c45-9d70-7153f4715160 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:40:24.244495 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eda835-3772-4c45-9d70-7153f4715160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:40:24.262395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-21eda835-3772-4c45-9d70-7153f4715160 None None] MFA Rules not processed for user `69f5eaf4727f4bbf84ce10a5e07d582e`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:40:24.263568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-21eda835-3772-4c45-9d70-7153f4715160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:40:24.315117 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1401/2773] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:40:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:40:46.437896 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e1e0-0e37-4c1d-913e-b0de13a19300 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:40:46.438415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e1e0-0e37-4c1d-913e-b0de13a19300 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:40:46.438507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e1e0-0e37-4c1d-913e-b0de13a19300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:40:46.492679 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2b04e1e0-0e37-4c1d-913e-b0de13a19300 None None] MFA Rules not processed for user `085b8de5c190423bb7ba5da5993479f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:40:46.493856 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2b04e1e0-0e37-4c1d-913e-b0de13a19300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:40:46.559711 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1373/2774] 10.222.0.32 () {58 vars in 967 bytes} [Tue Apr 12 00:40:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:40:46.602536 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eda835-3772-4c45-9d70-7153f4715160 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:40:46.604595 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-21eda835-3772-4c45-9d70-7153f4715160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:40:46.692688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eda835-3772-4c45-9d70-7153f4715160 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:40:46.698146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00128f-05d3-4546-8ac0-a8fa2c855745 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc91dcec14694193a8e60e32fc138b8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:40:46.698813 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00128f-05d3-4546-8ac0-a8fa2c855745 service swift] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:40:46.699102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00128f-05d3-4546-8ac0-a8fa2c855745 service swift] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:40:46.699373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00128f-05d3-4546-8ac0-a8fa2c855745 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:40:46.707046 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00128f-05d3-4546-8ac0-a8fa2c855745 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:40:46.708591 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00128f-05d3-4546-8ac0-a8fa2c855745 service swift] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:40:46.716233 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1402/2775] 10.222.0.32 () {60 vars in 1384 bytes} [Tue Apr 12 00:40:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:40:53.265081 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e1e0-0e37-4c1d-913e-b0de13a19300 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:40:53.266840 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2b04e1e0-0e37-4c1d-913e-b0de13a19300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:40:53.331950 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e1e0-0e37-4c1d-913e-b0de13a19300 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:40:53.336379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:40:53.337252 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:40:53.337536 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:40:53.338378 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] PATH_INFO: `/v3/users/fea857a427b0464daf88491b3d4ecbc3` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:40:53.339588 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea857a427b0464daf88491b3d4ecbc3)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:40:53.341506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:40:53.384445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea857a427b0464daf88491b3d4ecbc3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.391802 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea857a427b0464daf88491b3d4ecbc3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.398963 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea857a427b0464daf88491b3d4ecbc3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.399623 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea857a427b0464daf88491b3d4ecbc3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.400284 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea857a427b0464daf88491b3d4ecbc3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.416636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1374/2776] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:40:53 2022] DELETE /identity/v3/users/fea857a427b0464daf88491b3d4ecbc3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:40:53.586853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00128f-05d3-4546-8ac0-a8fa2c855745 service swift] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:40:53.600958 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00128f-05d3-4546-8ac0-a8fa2c855745 service swift] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:40:53.657705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:40:53.658788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:40:53.659128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:40:53.659473 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] PATH_INFO: `/v3/projects/ba38491d23d64bd58eabf7ea16fd68e8` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:40:53.660976 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba38491d23d64bd58eabf7ea16fd68e8)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:40:53.662973 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:40:53.713372 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba38491d23d64bd58eabf7ea16fd68e8', 'request_id': 'req-3bdc1e93-046e-4e85-b29f-942c7e7ce605'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.720354 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba38491d23d64bd58eabf7ea16fd68e8', 'request_id': 'req-3bdc1e93-046e-4e85-b29f-942c7e7ce605'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.726535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba38491d23d64bd58eabf7ea16fd68e8', 'request_id': 'req-3bdc1e93-046e-4e85-b29f-942c7e7ce605'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.736972 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] The token cache is being invalidate because project ba38491d23d64bd58eabf7ea16fd68e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:40:53.737289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.737924 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.739531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1403/2777] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:40:53 2022] DELETE /identity/v3/projects/ba38491d23d64bd58eabf7ea16fd68e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:40:53.743392 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:40:53.744909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:40:53.758189 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc94dbd-9dbf-43ba-9c0f-456a60768c7c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:40:53.813844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:40:53.814741 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:40:53.815023 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:40:53.815297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] PATH_INFO: `/v3/users/af3855f204384d6f86b6a13baa329cd8` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:40:53.816455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3855f204384d6f86b6a13baa329cd8)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:40:53.818404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:40:53.862520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3855f204384d6f86b6a13baa329cd8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.868938 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3855f204384d6f86b6a13baa329cd8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.876183 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3855f204384d6f86b6a13baa329cd8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.876789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3855f204384d6f86b6a13baa329cd8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.877382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3855f204384d6f86b6a13baa329cd8'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:53.893560 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1375/2778] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:40:53 2022] DELETE /identity/v3/users/af3855f204384d6f86b6a13baa329cd8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:40:54.067012 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:40:54.068445 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:40:54.082903 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc1e93-046e-4e85-b29f-942c7e7ce605 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:40:54.137176 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:40:54.137952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:40:54.138235 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:40:54.138535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] PATH_INFO: `/v3/projects/6919b51b902c42c29f2262d0515f56ac` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:40:54.139978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6919b51b902c42c29f2262d0515f56ac)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:40:54.141829 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:40:54.185762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6919b51b902c42c29f2262d0515f56ac', 'request_id': 'req-bb0400f0-5408-4d90-bdce-d53f0870ab27'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:54.192605 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6919b51b902c42c29f2262d0515f56ac', 'request_id': 'req-bb0400f0-5408-4d90-bdce-d53f0870ab27'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:54.198499 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6919b51b902c42c29f2262d0515f56ac', 'request_id': 'req-bb0400f0-5408-4d90-bdce-d53f0870ab27'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:54.208268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] The token cache is being invalidate because project 6919b51b902c42c29f2262d0515f56ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:40:54.208582 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:54.209207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:40:54.210824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1404/2779] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:40:54 2022] DELETE /identity/v3/projects/6919b51b902c42c29f2262d0515f56ac => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:41:46.306736 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:41:46.308136 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:41:46.398031 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cecd9-1bab-41c3-b9bb-32ae7221d37d admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:41:46.456789 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:41:46.457430 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:41:46.457715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:41:46.457991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:41:46.459778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:41:46.514710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:41:46.516212 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:41:46.525371 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1376/2780] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:41:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:41:47.908085 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:41:47.909497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:41:47.984548 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0400f0-5408-4d90-bdce-d53f0870ab27 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:41:47.988142 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622417b-f34f-4463-84f5-8e1f83d58d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:41:47.988788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622417b-f34f-4463-84f5-8e1f83d58d61 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:41:47.989071 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622417b-f34f-4463-84f5-8e1f83d58d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:41:47.989345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622417b-f34f-4463-84f5-8e1f83d58d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:41:47.991112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d622417b-f34f-4463-84f5-8e1f83d58d61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:41:48.005086 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622417b-f34f-4463-84f5-8e1f83d58d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:41:48.006526 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622417b-f34f-4463-84f5-8e1f83d58d61 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:41:48.017549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1405/2781] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:41:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:41:55.284086 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:41:55.285613 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:41:55.339016 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28007-70dd-408b-a33d-ea0a335b7e5c service nova] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:41:55.342541 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611bb1e-f933-4a24-996c-96558c46ea66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:41:55.343171 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bb1e-f933-4a24-996c-96558c46ea66 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:41:55.343449 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bb1e-f933-4a24-996c-96558c46ea66 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:41:55.343720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bb1e-f933-4a24-996c-96558c46ea66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:41:55.345439 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7611bb1e-f933-4a24-996c-96558c46ea66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:41:55.354380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611bb1e-f933-4a24-996c-96558c46ea66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:41:55.355788 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611bb1e-f933-4a24-996c-96558c46ea66 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:41:55.363402 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1377/2782] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:41:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:41:55.748569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622417b-f34f-4463-84f5-8e1f83d58d61 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:41:55.757089 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622417b-f34f-4463-84f5-8e1f83d58d61 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:41:55.761198 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:41:55.761830 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:41:55.762111 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:41:55.762444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:41:55.764426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:41:55.778185 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:41:55.779661 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:41:55.790629 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1406/2783] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:41:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:42:02.906988 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168a84f-52f0-401c-86ea-f61ed19ab010 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:42:02.907547 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168a84f-52f0-401c-86ea-f61ed19ab010 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:42:02.907792 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168a84f-52f0-401c-86ea-f61ed19ab010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:42:02.924297 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d168a84f-52f0-401c-86ea-f61ed19ab010 None None] MFA Rules not processed for user `69f5eaf4727f4bbf84ce10a5e07d582e`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:42:02.925484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d168a84f-52f0-401c-86ea-f61ed19ab010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:42:02.932734 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1378/2784] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:42:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:42:11.334660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:42:11.336679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:42:11.350706 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c571b-e3cf-44ce-a76d-8ba0193272e7 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:42:11.356926 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5b252-f482-4792-a9e5-1298b71ea5db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:42:11.357570 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b252-f482-4792-a9e5-1298b71ea5db service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:42:11.357851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b252-f482-4792-a9e5-1298b71ea5db service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:42:11.358213 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b252-f482-4792-a9e5-1298b71ea5db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:42:11.360009 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-4fd5b252-f482-4792-a9e5-1298b71ea5db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:42:11.371978 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5b252-f482-4792-a9e5-1298b71ea5db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:42:11.373528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5b252-f482-4792-a9e5-1298b71ea5db service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:42:11.383878 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1407/2785] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:42:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:42:15.314795 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168a84f-52f0-401c-86ea-f61ed19ab010 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:42:15.316482 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d168a84f-52f0-401c-86ea-f61ed19ab010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:42:15.331913 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168a84f-52f0-401c-86ea-f61ed19ab010 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:42:15.337315 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9076a0-2cf9-4f33-a78c-102e17f43d0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:42:15.337956 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9076a0-2cf9-4f33-a78c-102e17f43d0b service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:42:15.338241 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9076a0-2cf9-4f33-a78c-102e17f43d0b service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:42:15.338540 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9076a0-2cf9-4f33-a78c-102e17f43d0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:42:15.340259 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-be9076a0-2cf9-4f33-a78c-102e17f43d0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:42:15.352639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9076a0-2cf9-4f33-a78c-102e17f43d0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:42:15.354218 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9076a0-2cf9-4f33-a78c-102e17f43d0b service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:42:15.364647 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1379/2786] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:42:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:43:41.785658 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5b252-f482-4792-a9e5-1298b71ea5db service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:41.797477 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5b252-f482-4792-a9e5-1298b71ea5db service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:41.804584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:41.805328 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:41.805790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:41.806292 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:41.808861 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:41.823932 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:41.825811 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:41.839366 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1408/2787] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:43:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:43:46.729405 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9076a0-2cf9-4f33-a78c-102e17f43d0b service nova] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:46.738552 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9076a0-2cf9-4f33-a78c-102e17f43d0b service nova] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:46.742106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a326b7-ff6f-4bcb-b967-60e8b9d00ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:46.742772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a326b7-ff6f-4bcb-b967-60e8b9d00ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:46.743053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a326b7-ff6f-4bcb-b967-60e8b9d00ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:46.743325 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a326b7-ff6f-4bcb-b967-60e8b9d00ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:46.745056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-15a326b7-ff6f-4bcb-b967-60e8b9d00ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:46.812749 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a326b7-ff6f-4bcb-b967-60e8b9d00ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:46.814173 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a326b7-ff6f-4bcb-b967-60e8b9d00ad3 service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:46.823533 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1380/2788] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:43:49.984456 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:49.985974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:49.999546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0815be-4dd2-4fbc-b532-dea278330e75 service nova] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:50.004186 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:50.005623 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.005908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.006180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] PATH_INFO: `/v3/users/69f5eaf4727f4bbf84ce10a5e07d582e` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.007373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f5eaf4727f4bbf84ce10a5e07d582e)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:50.009251 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:50.053171 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f5eaf4727f4bbf84ce10a5e07d582e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.059789 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f5eaf4727f4bbf84ce10a5e07d582e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.067899 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f5eaf4727f4bbf84ce10a5e07d582e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.068575 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f5eaf4727f4bbf84ce10a5e07d582e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.069178 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-6a9042c6-ca30-4929-b903-cd0193f50c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f5eaf4727f4bbf84ce10a5e07d582e'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.085327 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1409/2789] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:43:49 2022] DELETE /identity/v3/users/69f5eaf4727f4bbf84ce10a5e07d582e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:43:50.257485 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a326b7-ff6f-4bcb-b967-60e8b9d00ad3 service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:50.267676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a326b7-ff6f-4bcb-b967-60e8b9d00ad3 service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:50.333476 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:50.334369 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.334655 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.334954 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] PATH_INFO: `/v3/projects/add150d29f3d4ccc8d4e3775577e3d57` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.336110 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=add150d29f3d4ccc8d4e3775577e3d57)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:50.337987 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:50.380625 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'add150d29f3d4ccc8d4e3775577e3d57', 'request_id': 'req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.386411 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'add150d29f3d4ccc8d4e3775577e3d57', 'request_id': 'req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.391797 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'add150d29f3d4ccc8d4e3775577e3d57', 'request_id': 'req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.404724 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] The token cache is being invalidate because project add150d29f3d4ccc8d4e3775577e3d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:43:50.405010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.405649 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-41bed7ef-65f7-4d2f-8c00-5bce630a7ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:50.407228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1381/2790] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:43:50 2022] DELETE /identity/v3/projects/add150d29f3d4ccc8d4e3775577e3d57 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:43:50.412896 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e5c0-14e9-4263-8a32-f52045b5069c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.413182 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e5c0-14e9-4263-8a32-f52045b5069c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.413459 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8e5c0-14e9-4263-8a32-f52045b5069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.466812 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-b1d8e5c0-14e9-4263-8a32-f52045b5069c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:43:50.467941 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-b1d8e5c0-14e9-4263-8a32-f52045b5069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:50.524726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1410/2791] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:43:50.532403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42572ec6-0149-4a9f-8d8e-922ce6abc91a None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.532695 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42572ec6-0149-4a9f-8d8e-922ce6abc91a None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.532971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42572ec6-0149-4a9f-8d8e-922ce6abc91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.550809 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-42572ec6-0149-4a9f-8d8e-922ce6abc91a None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:43:50.551996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-42572ec6-0149-4a9f-8d8e-922ce6abc91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:50.559710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1382/2792] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:43:50.563679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8e5c0-14e9-4263-8a32-f52045b5069c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:50.573472 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8e5c0-14e9-4263-8a32-f52045b5069c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:50.577956 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404a263-124f-44db-939b-2b144fad7916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:50.578635 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404a263-124f-44db-939b-2b144fad7916 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.578917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404a263-124f-44db-939b-2b144fad7916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.579193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404a263-124f-44db-939b-2b144fad7916 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.579910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404a263-124f-44db-939b-2b144fad7916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:43:50.580216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404a263-124f-44db-939b-2b144fad7916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:50.581790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404a263-124f-44db-939b-2b144fad7916 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:50.593347 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1411/2793] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:43:50.597321 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42572ec6-0149-4a9f-8d8e-922ce6abc91a None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:50.606204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42572ec6-0149-4a9f-8d8e-922ce6abc91a None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:50.610794 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64142f0e-836b-4ce9-afde-fe54a2838e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:50.611437 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64142f0e-836b-4ce9-afde-fe54a2838e82 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.611718 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64142f0e-836b-4ce9-afde-fe54a2838e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.611993 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64142f0e-836b-4ce9-afde-fe54a2838e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.612684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64142f0e-836b-4ce9-afde-fe54a2838e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:50.614598 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64142f0e-836b-4ce9-afde-fe54a2838e82 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:50.648778 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1383/2794] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:43:50 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:43:50.652675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404a263-124f-44db-939b-2b144fad7916 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:50.662606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404a263-124f-44db-939b-2b144fad7916 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:50.715374 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932582eb-d970-4aa5-8c09-326cc5fbb5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:50.716040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932582eb-d970-4aa5-8c09-326cc5fbb5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.716324 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932582eb-d970-4aa5-8c09-326cc5fbb5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.716599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932582eb-d970-4aa5-8c09-326cc5fbb5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.717334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932582eb-d970-4aa5-8c09-326cc5fbb5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:50.719383 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932582eb-d970-4aa5-8c09-326cc5fbb5d4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:50.738193 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1412/2795] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:43:50 2022] POST /identity/v3/users => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:43:50.742379 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64142f0e-836b-4ce9-afde-fe54a2838e82 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:50.752231 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64142f0e-836b-4ce9-afde-fe54a2838e82 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:50.757258 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4570f-4357-4d34-9c27-2b21abc7ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:50.757911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4570f-4357-4d34-9c27-2b21abc7ce0e admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.758197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4570f-4357-4d34-9c27-2b21abc7ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.758576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4570f-4357-4d34-9c27-2b21abc7ce0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.759324 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4570f-4357-4d34-9c27-2b21abc7ce0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:50.760905 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4570f-4357-4d34-9c27-2b21abc7ce0e admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:50.771562 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1384/2796] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:43:50.775078 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932582eb-d970-4aa5-8c09-326cc5fbb5d4 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:50.784764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932582eb-d970-4aa5-8c09-326cc5fbb5d4 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:50.789281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ab92c-1902-4998-888b-221ca335cbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:50.789955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ab92c-1902-4998-888b-221ca335cbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.790238 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ab92c-1902-4998-888b-221ca335cbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.790547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ab92c-1902-4998-888b-221ca335cbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.791255 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ab92c-1902-4998-888b-221ca335cbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:50.792824 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ab92c-1902-4998-888b-221ca335cbb2 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:50.802297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1413/2797] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:43:50.806053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4570f-4357-4d34-9c27-2b21abc7ce0e admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:50.815964 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4570f-4357-4d34-9c27-2b21abc7ce0e admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:50.821112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaef5d-6b1e-46d6-861d-812acb19d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:50.821983 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaef5d-6b1e-46d6-861d-812acb19d531 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.822275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaef5d-6b1e-46d6-861d-812acb19d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.822570 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaef5d-6b1e-46d6-861d-812acb19d531 admin admin] PATH_INFO: `/v3/projects/dc271d1d1fcb4aefbc5b18d6ea5f6c8c/users/cc1a17a826b14ce6bf9ede638b55e3e4/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.836488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaef5d-6b1e-46d6-861d-812acb19d531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc271d1d1fcb4aefbc5b18d6ea5f6c8c, user_id=cc1a17a826b14ce6bf9ede638b55e3e4, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:50.839520 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaef5d-6b1e-46d6-861d-812acb19d531 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:50.855101 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1385/2798] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:43:50 2022] PUT /identity/v3/projects/dc271d1d1fcb4aefbc5b18d6ea5f6c8c/users/cc1a17a826b14ce6bf9ede638b55e3e4/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:43:50.866202 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61057c2-3221-4950-960d-014562f19b91 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:50.866523 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61057c2-3221-4950-960d-014562f19b91 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:50.866800 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61057c2-3221-4950-960d-014562f19b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:50.893044 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-d61057c2-3221-4950-960d-014562f19b91 None None] MFA Rules not processed for user `cc1a17a826b14ce6bf9ede638b55e3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:43:50.894244 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-d61057c2-3221-4950-960d-014562f19b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:50.954006 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1414/2799] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:43:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:43:50.965568 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaef5d-6b1e-46d6-861d-812acb19d531 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:50.967296 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-cfbaef5d-6b1e-46d6-861d-812acb19d531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:51.037431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaef5d-6b1e-46d6-861d-812acb19d531 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:51.042775 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756552f-8725-4acf-8f44-80b2d87a2f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecf0479293de4edfbf2815c1e9f2f7cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:51.043418 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756552f-8725-4acf-8f44-80b2d87a2f29 service nova] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:51.043701 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756552f-8725-4acf-8f44-80b2d87a2f29 service nova] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:51.043974 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756552f-8725-4acf-8f44-80b2d87a2f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:51.051434 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756552f-8725-4acf-8f44-80b2d87a2f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:51.053003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756552f-8725-4acf-8f44-80b2d87a2f29 service nova] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:51.061842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1386/2800] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:43:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:43:51.231851 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61057c2-3221-4950-960d-014562f19b91 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:51.291463 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61057c2-3221-4950-960d-014562f19b91 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:51.295821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:51.296668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:51.296950 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:51.297224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] PATH_INFO: `/v3/users/cc1a17a826b14ce6bf9ede638b55e3e4` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:51.298412 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1a17a826b14ce6bf9ede638b55e3e4)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:51.300309 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:51.343697 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1a17a826b14ce6bf9ede638b55e3e4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.350276 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1a17a826b14ce6bf9ede638b55e3e4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.357225 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1a17a826b14ce6bf9ede638b55e3e4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.357834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1a17a826b14ce6bf9ede638b55e3e4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.358461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1a17a826b14ce6bf9ede638b55e3e4'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.374869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1415/2801] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:43:51 2022] DELETE /identity/v3/users/cc1a17a826b14ce6bf9ede638b55e3e4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:43:51.379340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a815c5-18b9-4bf6-a437-bbebded68fa5 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:51.380370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a815c5-18b9-4bf6-a437-bbebded68fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:51.380490 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a815c5-18b9-4bf6-a437-bbebded68fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:51.397545 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e0a815c5-18b9-4bf6-a437-bbebded68fa5 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:43:51.398773 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e0a815c5-18b9-4bf6-a437-bbebded68fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:51.455503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1387/2802] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:43:51.465757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:51.467180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:51.522581 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b8403-10df-4d77-8356-a8fd8b131ad7 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:51.526140 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052dca6-0273-4d16-bf69-a874d6cc58a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:51.526869 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052dca6-0273-4d16-bf69-a874d6cc58a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:51.527152 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052dca6-0273-4d16-bf69-a874d6cc58a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:51.527430 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052dca6-0273-4d16-bf69-a874d6cc58a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:51.536209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052dca6-0273-4d16-bf69-a874d6cc58a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:51.537609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052dca6-0273-4d16-bf69-a874d6cc58a6 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:51.546790 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1416/2803] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:43:51.799866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a815c5-18b9-4bf6-a437-bbebded68fa5 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:51.801202 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e0a815c5-18b9-4bf6-a437-bbebded68fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:51.815277 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a815c5-18b9-4bf6-a437-bbebded68fa5 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:51.820524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:51.821375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:51.821653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:51.821924 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] PATH_INFO: `/v3/projects/dc271d1d1fcb4aefbc5b18d6ea5f6c8c` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:51.823143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc271d1d1fcb4aefbc5b18d6ea5f6c8c)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:51.825747 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:51.871710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc271d1d1fcb4aefbc5b18d6ea5f6c8c', 'request_id': 'req-ffbeceb8-f040-4872-8f95-5a30d686b3e1'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.877526 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc271d1d1fcb4aefbc5b18d6ea5f6c8c', 'request_id': 'req-ffbeceb8-f040-4872-8f95-5a30d686b3e1'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.883117 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc271d1d1fcb4aefbc5b18d6ea5f6c8c', 'request_id': 'req-ffbeceb8-f040-4872-8f95-5a30d686b3e1'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.894966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] The token cache is being invalidate because project dc271d1d1fcb4aefbc5b18d6ea5f6c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:43:51.895252 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.896400 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-ffbeceb8-f040-4872-8f95-5a30d686b3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:43:51.897945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1388/2804] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:43:51 2022] DELETE /identity/v3/projects/dc271d1d1fcb4aefbc5b18d6ea5f6c8c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:43:51.902833 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee343697-e5e1-4af1-b0ce-82ebc43e50a2 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:51.903129 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee343697-e5e1-4af1-b0ce-82ebc43e50a2 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:51.903414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee343697-e5e1-4af1-b0ce-82ebc43e50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:51.921359 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-ee343697-e5e1-4af1-b0ce-82ebc43e50a2 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:43:51.922581 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-ee343697-e5e1-4af1-b0ce-82ebc43e50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:51.981130 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1417/2805] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:43:51.988885 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844df6f-29dc-4df9-a960-7813277f876c None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:51.989694 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844df6f-29dc-4df9-a960-7813277f876c None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:51.989978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844df6f-29dc-4df9-a960-7813277f876c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.008602 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-1844df6f-29dc-4df9-a960-7813277f876c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:43:52.009807 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-1844df6f-29dc-4df9-a960-7813277f876c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:52.017868 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1389/2806] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:43:52.022187 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee343697-e5e1-4af1-b0ce-82ebc43e50a2 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.032483 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee343697-e5e1-4af1-b0ce-82ebc43e50a2 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.037498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476a568-e30c-417b-8565-aef82785bb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.038150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476a568-e30c-417b-8565-aef82785bb7b admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.038464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476a568-e30c-417b-8565-aef82785bb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.038741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476a568-e30c-417b-8565-aef82785bb7b admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.039457 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476a568-e30c-417b-8565-aef82785bb7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:43:52.039762 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476a568-e30c-417b-8565-aef82785bb7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.041337 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476a568-e30c-417b-8565-aef82785bb7b admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.052952 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1418/2807] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:43:52.057099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844df6f-29dc-4df9-a960-7813277f876c None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.066019 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844df6f-29dc-4df9-a960-7813277f876c None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.070916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3374c-a9d8-4bf8-87e3-ee149edac6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.071583 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3374c-a9d8-4bf8-87e3-ee149edac6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.071857 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3374c-a9d8-4bf8-87e3-ee149edac6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.072128 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3374c-a9d8-4bf8-87e3-ee149edac6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.072835 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3374c-a9d8-4bf8-87e3-ee149edac6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.074732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3374c-a9d8-4bf8-87e3-ee149edac6d9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.099505 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1390/2808] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:43:52 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:43:52.103608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476a568-e30c-417b-8565-aef82785bb7b admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.113404 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476a568-e30c-417b-8565-aef82785bb7b admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.166105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb0220-6f41-4428-abec-00c4d0b324f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.166784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb0220-6f41-4428-abec-00c4d0b324f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.167064 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb0220-6f41-4428-abec-00c4d0b324f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.167335 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb0220-6f41-4428-abec-00c4d0b324f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.168008 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb0220-6f41-4428-abec-00c4d0b324f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.169871 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb0220-6f41-4428-abec-00c4d0b324f4 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.188280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1419/2809] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:43:52 2022] POST /identity/v3/users => generated 287 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:43:52.192834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3374c-a9d8-4bf8-87e3-ee149edac6d9 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.202706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3374c-a9d8-4bf8-87e3-ee149edac6d9 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.207609 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4672e1-51ed-4a9e-a7af-a25ee370f79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.208863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4672e1-51ed-4a9e-a7af-a25ee370f79c admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.209138 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4672e1-51ed-4a9e-a7af-a25ee370f79c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.209410 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4672e1-51ed-4a9e-a7af-a25ee370f79c admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.210245 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4672e1-51ed-4a9e-a7af-a25ee370f79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.211850 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4672e1-51ed-4a9e-a7af-a25ee370f79c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.222012 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1391/2810] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:43:52.225769 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb0220-6f41-4428-abec-00c4d0b324f4 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.235433 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb0220-6f41-4428-abec-00c4d0b324f4 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.239963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731f4ad-f458-42db-acc4-0ccc915a1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.240602 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731f4ad-f458-42db-acc4-0ccc915a1af9 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.240883 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731f4ad-f458-42db-acc4-0ccc915a1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.241153 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731f4ad-f458-42db-acc4-0ccc915a1af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.241859 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731f4ad-f458-42db-acc4-0ccc915a1af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.243439 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6731f4ad-f458-42db-acc4-0ccc915a1af9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.252835 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1420/2811] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:43:52.257076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4672e1-51ed-4a9e-a7af-a25ee370f79c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.266920 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4672e1-51ed-4a9e-a7af-a25ee370f79c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.272060 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89711f1-0c73-4fe7-8200-8ec7bf188058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.272908 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89711f1-0c73-4fe7-8200-8ec7bf188058 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.273185 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89711f1-0c73-4fe7-8200-8ec7bf188058 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.273455 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89711f1-0c73-4fe7-8200-8ec7bf188058 admin admin] PATH_INFO: `/v3/projects/49b4a6d0cafa46d0976fa51bc0c508e7/users/9293d9e80ea64505be70d285c40dc8db/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.287023 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89711f1-0c73-4fe7-8200-8ec7bf188058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b4a6d0cafa46d0976fa51bc0c508e7, user_id=9293d9e80ea64505be70d285c40dc8db, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.289638 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89711f1-0c73-4fe7-8200-8ec7bf188058 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.301662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1392/2812] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:43:52 2022] PUT /identity/v3/projects/49b4a6d0cafa46d0976fa51bc0c508e7/users/9293d9e80ea64505be70d285c40dc8db/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:43:52.311917 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a58c-ddde-47a3-8830-22396cc91dde None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.312146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a58c-ddde-47a3-8830-22396cc91dde None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.312448 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2a58c-ddde-47a3-8830-22396cc91dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.338067 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-23d2a58c-ddde-47a3-8830-22396cc91dde None None] MFA Rules not processed for user `9293d9e80ea64505be70d285c40dc8db`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:43:52.339281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-23d2a58c-ddde-47a3-8830-22396cc91dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:52.399783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1421/2813] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:43:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:43:52.404244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89711f1-0c73-4fe7-8200-8ec7bf188058 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.462759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89711f1-0c73-4fe7-8200-8ec7bf188058 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.467488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3f8de-be02-445c-be3a-c8e173c412c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.468162 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3f8de-be02-445c-be3a-c8e173c412c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.468445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3f8de-be02-445c-be3a-c8e173c412c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.468710 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3f8de-be02-445c-be3a-c8e173c412c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.469386 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3f8de-be02-445c-be3a-c8e173c412c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.471316 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3f8de-be02-445c-be3a-c8e173c412c4 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.495380 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1393/2814] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:43:52 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:43:52.499391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2a58c-ddde-47a3-8830-22396cc91dde None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.509902 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2a58c-ddde-47a3-8830-22396cc91dde None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.564145 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e08423-3796-41a0-8ae0-1dfd38c67dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.564734 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e08423-3796-41a0-8ae0-1dfd38c67dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.565019 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e08423-3796-41a0-8ae0-1dfd38c67dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.565293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e08423-3796-41a0-8ae0-1dfd38c67dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.565974 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e08423-3796-41a0-8ae0-1dfd38c67dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.568531 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e08423-3796-41a0-8ae0-1dfd38c67dc9 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.588402 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1422/2815] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:43:52 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:43:52.592381 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3f8de-be02-445c-be3a-c8e173c412c4 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.602229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3f8de-be02-445c-be3a-c8e173c412c4 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.606936 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564211d-d25b-4001-9ffc-0ad65e16edb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.607581 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564211d-d25b-4001-9ffc-0ad65e16edb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.607861 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564211d-d25b-4001-9ffc-0ad65e16edb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.608134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564211d-d25b-4001-9ffc-0ad65e16edb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.608844 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564211d-d25b-4001-9ffc-0ad65e16edb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.610477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564211d-d25b-4001-9ffc-0ad65e16edb9 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.621049 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1394/2816] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:43:52.625101 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e08423-3796-41a0-8ae0-1dfd38c67dc9 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.635319 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e08423-3796-41a0-8ae0-1dfd38c67dc9 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.640128 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663615a-ff8a-4db6-bf5a-2b5e84f8c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.640986 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663615a-ff8a-4db6-bf5a-2b5e84f8c7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.641267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663615a-ff8a-4db6-bf5a-2b5e84f8c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.641536 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663615a-ff8a-4db6-bf5a-2b5e84f8c7d5 admin admin] PATH_INFO: `/v3/projects/a4e76ddb02c1458b8796ed2fb651e764/users/7330f9492efc437a97d28d1c50f3e27a/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.655481 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663615a-ff8a-4db6-bf5a-2b5e84f8c7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e76ddb02c1458b8796ed2fb651e764, user_id=7330f9492efc437a97d28d1c50f3e27a, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.658162 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663615a-ff8a-4db6-bf5a-2b5e84f8c7d5 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.671189 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1423/2817] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:43:52 2022] PUT /identity/v3/projects/a4e76ddb02c1458b8796ed2fb651e764/users/7330f9492efc437a97d28d1c50f3e27a/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:43:52.675089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564211d-d25b-4001-9ffc-0ad65e16edb9 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.685443 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564211d-d25b-4001-9ffc-0ad65e16edb9 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.738165 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65b369-358c-4fe4-beff-d8d65d17f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.738849 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b369-358c-4fe4-beff-d8d65d17f5da admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.739664 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b369-358c-4fe4-beff-d8d65d17f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.739945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b369-358c-4fe4-beff-d8d65d17f5da admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.740650 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65b369-358c-4fe4-beff-d8d65d17f5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.742220 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65b369-358c-4fe4-beff-d8d65d17f5da admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.751475 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1395/2818] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:43:52.756256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663615a-ff8a-4db6-bf5a-2b5e84f8c7d5 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.766231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663615a-ff8a-4db6-bf5a-2b5e84f8c7d5 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.770815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c34064-a4e1-49bb-bb11-52caeee7aaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.771784 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c34064-a4e1-49bb-bb11-52caeee7aaf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.772069 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c34064-a4e1-49bb-bb11-52caeee7aaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.772341 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c34064-a4e1-49bb-bb11-52caeee7aaf6 admin admin] PATH_INFO: `/v3/projects/a4e76ddb02c1458b8796ed2fb651e764/users/7330f9492efc437a97d28d1c50f3e27a/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.774268 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c34064-a4e1-49bb-bb11-52caeee7aaf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e76ddb02c1458b8796ed2fb651e764, user_id=7330f9492efc437a97d28d1c50f3e27a, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.776846 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c34064-a4e1-49bb-bb11-52caeee7aaf6 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.786963 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1424/2819] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:43:52 2022] PUT /identity/v3/projects/a4e76ddb02c1458b8796ed2fb651e764/users/7330f9492efc437a97d28d1c50f3e27a/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:43:52.798051 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6002a-cc0a-43e6-89cd-d9bc3881b94e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.798383 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6002a-cc0a-43e6-89cd-d9bc3881b94e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.798672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6002a-cc0a-43e6-89cd-d9bc3881b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.824950 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-99a6002a-cc0a-43e6-89cd-d9bc3881b94e None None] MFA Rules not processed for user `7330f9492efc437a97d28d1c50f3e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:43:52.826091 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-99a6002a-cc0a-43e6-89cd-d9bc3881b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:52.892290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1396/2820] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:43:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:43:52.904010 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c34064-a4e1-49bb-bb11-52caeee7aaf6 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:52.905687 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-a6c34064-a4e1-49bb-bb11-52caeee7aaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:43:52.962131 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c34064-a4e1-49bb-bb11-52caeee7aaf6 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:52.965663 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9a62-463b-434e-acda-48895fdc22a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:52.966392 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9a62-463b-434e-acda-48895fdc22a5 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:52.966676 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9a62-463b-434e-acda-48895fdc22a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:52.966950 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9a62-463b-434e-acda-48895fdc22a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:52.975862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b9a62-463b-434e-acda-48895fdc22a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:52.977258 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b9a62-463b-434e-acda-48895fdc22a5 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:52.986679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1425/2821] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:43:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:43:53.057732 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6002a-cc0a-43e6-89cd-d9bc3881b94e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:43:53.067163 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6002a-cc0a-43e6-89cd-d9bc3881b94e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:43:53.071288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ce480-35b9-4d74-8284-529fa8d01b54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:43:53.071916 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ce480-35b9-4d74-8284-529fa8d01b54 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:43:53.072197 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ce480-35b9-4d74-8284-529fa8d01b54 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:43:53.072473 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ce480-35b9-4d74-8284-529fa8d01b54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:43:53.126580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ce480-35b9-4d74-8284-529fa8d01b54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:43:53.127926 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ce480-35b9-4d74-8284-529fa8d01b54 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:43:53.137099 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1397/2822] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:43:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:44:34.907121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9a62-463b-434e-acda-48895fdc22a5 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:34.967714 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9a62-463b-434e-acda-48895fdc22a5 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:34.972291 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:34.973150 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:34.973432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:34.973709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] PATH_INFO: `/v3/users/9293d9e80ea64505be70d285c40dc8db` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:34.974880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9293d9e80ea64505be70d285c40dc8db)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:34.976785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:35.020730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9293d9e80ea64505be70d285c40dc8db'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.027191 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9293d9e80ea64505be70d285c40dc8db'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.033870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9293d9e80ea64505be70d285c40dc8db'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.034509 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9293d9e80ea64505be70d285c40dc8db'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.035212 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9293d9e80ea64505be70d285c40dc8db'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.051849 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1426/2823] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:44:34 2022] DELETE /identity/v3/users/9293d9e80ea64505be70d285c40dc8db => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:44:35.056421 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ccab-5987-46f9-9e05-cd7d1e711c41 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:35.056929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ccab-5987-46f9-9e05-cd7d1e711c41 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:35.057041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ccab-5987-46f9-9e05-cd7d1e711c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:35.073909 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-dc05ccab-5987-46f9-9e05-cd7d1e711c41 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:35.075051 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-dc05ccab-5987-46f9-9e05-cd7d1e711c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:35.130495 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1398/2824] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:44:35.140289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:35.141701 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:35.196154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fb213-c7be-49f6-82fc-4cb629d6ce04 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:35.199736 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11aa72-1fa7-48af-be9e-82d65fb65f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:35.200377 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11aa72-1fa7-48af-be9e-82d65fb65f87 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:35.200660 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11aa72-1fa7-48af-be9e-82d65fb65f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:35.200933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11aa72-1fa7-48af-be9e-82d65fb65f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:35.210081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11aa72-1fa7-48af-be9e-82d65fb65f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:35.211527 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11aa72-1fa7-48af-be9e-82d65fb65f87 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:35.220549 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1427/2825] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:44:35.475483 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ccab-5987-46f9-9e05-cd7d1e711c41 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:35.476998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-dc05ccab-5987-46f9-9e05-cd7d1e711c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:35.496347 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ccab-5987-46f9-9e05-cd7d1e711c41 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:35.501814 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:35.502706 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:35.502982 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:35.503251 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] PATH_INFO: `/v3/projects/49b4a6d0cafa46d0976fa51bc0c508e7` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:35.505052 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b4a6d0cafa46d0976fa51bc0c508e7)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:35.506966 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:35.553416 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b4a6d0cafa46d0976fa51bc0c508e7', 'request_id': 'req-7197ed66-fcf5-4ede-8000-fb71efaa5e76'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.559326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b4a6d0cafa46d0976fa51bc0c508e7', 'request_id': 'req-7197ed66-fcf5-4ede-8000-fb71efaa5e76'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.564702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b4a6d0cafa46d0976fa51bc0c508e7', 'request_id': 'req-7197ed66-fcf5-4ede-8000-fb71efaa5e76'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.577170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] The token cache is being invalidate because project 49b4a6d0cafa46d0976fa51bc0c508e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:44:35.577448 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.578056 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.579603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1399/2826] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:44:35 2022] DELETE /identity/v3/projects/49b4a6d0cafa46d0976fa51bc0c508e7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:35.583559 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11aa72-1fa7-48af-be9e-82d65fb65f87 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:35.592938 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11aa72-1fa7-48af-be9e-82d65fb65f87 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:35.647303 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:35.648163 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:35.648511 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:35.648945 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] PATH_INFO: `/v3/users/7330f9492efc437a97d28d1c50f3e27a` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:35.650183 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7330f9492efc437a97d28d1c50f3e27a)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:35.652116 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:35.695821 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7330f9492efc437a97d28d1c50f3e27a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.702218 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7330f9492efc437a97d28d1c50f3e27a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.709048 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7330f9492efc437a97d28d1c50f3e27a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.709657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7330f9492efc437a97d28d1c50f3e27a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.710256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-caaa3a44-cfff-44ad-8adf-e80427b7b7ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7330f9492efc437a97d28d1c50f3e27a'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:35.726739 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1428/2827] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:44:35 2022] DELETE /identity/v3/users/7330f9492efc437a97d28d1c50f3e27a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:35.988784 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:35.990356 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:36.006154 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197ed66-fcf5-4ede-8000-fb71efaa5e76 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.061767 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.062653 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.062935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.063211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] PATH_INFO: `/v3/projects/a4e76ddb02c1458b8796ed2fb651e764` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.064391 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e76ddb02c1458b8796ed2fb651e764)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.066349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.109888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e76ddb02c1458b8796ed2fb651e764', 'request_id': 'req-a098c25e-36d4-4872-9479-a3c7efc057a0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:36.115742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e76ddb02c1458b8796ed2fb651e764', 'request_id': 'req-a098c25e-36d4-4872-9479-a3c7efc057a0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:36.120874 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e76ddb02c1458b8796ed2fb651e764', 'request_id': 'req-a098c25e-36d4-4872-9479-a3c7efc057a0'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:36.132126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] The token cache is being invalidate because project a4e76ddb02c1458b8796ed2fb651e764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:44:36.132404 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:36.133009 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-a098c25e-36d4-4872-9479-a3c7efc057a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:36.134531 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1400/2828] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:44:35 2022] DELETE /identity/v3/projects/a4e76ddb02c1458b8796ed2fb651e764 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:36.139786 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f73d7c-b89e-45f3-9a6a-7153f7524e12 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.140254 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f73d7c-b89e-45f3-9a6a-7153f7524e12 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.140388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f73d7c-b89e-45f3-9a6a-7153f7524e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.158317 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-75f73d7c-b89e-45f3-9a6a-7153f7524e12 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:36.159490 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-75f73d7c-b89e-45f3-9a6a-7153f7524e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:36.214083 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1429/2829] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:44:36.222685 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117dbce-26b4-419b-b1bf-fb7facd7ce23 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.222972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117dbce-26b4-419b-b1bf-fb7facd7ce23 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.223249 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117dbce-26b4-419b-b1bf-fb7facd7ce23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.241285 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-3117dbce-26b4-419b-b1bf-fb7facd7ce23 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:36.242484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-3117dbce-26b4-419b-b1bf-fb7facd7ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:36.250089 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1401/2830] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:36.254765 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f73d7c-b89e-45f3-9a6a-7153f7524e12 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.264578 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f73d7c-b89e-45f3-9a6a-7153f7524e12 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.269075 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a18f-9bf2-48ca-bf84-79252ca94285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.269716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a18f-9bf2-48ca-bf84-79252ca94285 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.269996 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a18f-9bf2-48ca-bf84-79252ca94285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.270299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777a18f-9bf2-48ca-bf84-79252ca94285 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.271065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777a18f-9bf2-48ca-bf84-79252ca94285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:44:36.271369 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777a18f-9bf2-48ca-bf84-79252ca94285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.272927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777a18f-9bf2-48ca-bf84-79252ca94285 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.283927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1430/2831] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:44:36.288445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117dbce-26b4-419b-b1bf-fb7facd7ce23 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.297267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117dbce-26b4-419b-b1bf-fb7facd7ce23 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.302451 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822864c-b52a-4afe-b592-19daa006ba09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.303109 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822864c-b52a-4afe-b592-19daa006ba09 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.303388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822864c-b52a-4afe-b592-19daa006ba09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.303660 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822864c-b52a-4afe-b592-19daa006ba09 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.304361 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822864c-b52a-4afe-b592-19daa006ba09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.306244 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822864c-b52a-4afe-b592-19daa006ba09 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.330075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1402/2832] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:44:36 2022] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:36.334211 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a18f-9bf2-48ca-bf84-79252ca94285 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.344065 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777a18f-9bf2-48ca-bf84-79252ca94285 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.397928 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e72f-7fd7-4ce4-95d9-97d4bc3c1742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.398621 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e72f-7fd7-4ce4-95d9-97d4bc3c1742 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.398907 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e72f-7fd7-4ce4-95d9-97d4bc3c1742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.399184 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4e72f-7fd7-4ce4-95d9-97d4bc3c1742 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.399873 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e72f-7fd7-4ce4-95d9-97d4bc3c1742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.401768 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4e72f-7fd7-4ce4-95d9-97d4bc3c1742 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.420461 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1431/2833] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:44:36 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:36.424488 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822864c-b52a-4afe-b592-19daa006ba09 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.434239 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822864c-b52a-4afe-b592-19daa006ba09 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.438723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28500d13-e337-4832-aac7-3a6a9fca4cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.439368 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28500d13-e337-4832-aac7-3a6a9fca4cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.439647 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28500d13-e337-4832-aac7-3a6a9fca4cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.439918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28500d13-e337-4832-aac7-3a6a9fca4cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.440630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28500d13-e337-4832-aac7-3a6a9fca4cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.442777 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28500d13-e337-4832-aac7-3a6a9fca4cf2 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.453229 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1403/2834] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:44:36.457609 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e72f-7fd7-4ce4-95d9-97d4bc3c1742 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.467304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4e72f-7fd7-4ce4-95d9-97d4bc3c1742 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.471729 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5581b-99ea-4024-89f8-bedcde1b2843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.472425 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5581b-99ea-4024-89f8-bedcde1b2843 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.472705 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5581b-99ea-4024-89f8-bedcde1b2843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.472982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5581b-99ea-4024-89f8-bedcde1b2843 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.473702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5581b-99ea-4024-89f8-bedcde1b2843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.475313 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5581b-99ea-4024-89f8-bedcde1b2843 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.485173 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1432/2835] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:44:36.489267 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28500d13-e337-4832-aac7-3a6a9fca4cf2 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.498918 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28500d13-e337-4832-aac7-3a6a9fca4cf2 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.504020 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998f5bb-2012-49df-a690-f1c6fb00d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.504886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f5bb-2012-49df-a690-f1c6fb00d375 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.505170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f5bb-2012-49df-a690-f1c6fb00d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.505446 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998f5bb-2012-49df-a690-f1c6fb00d375 admin admin] PATH_INFO: `/v3/projects/36084886c904484f9964a9a1dbd03735/users/0dc625baeab54d09819628409bd437d3/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.520188 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998f5bb-2012-49df-a690-f1c6fb00d375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36084886c904484f9964a9a1dbd03735, user_id=0dc625baeab54d09819628409bd437d3, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.522886 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998f5bb-2012-49df-a690-f1c6fb00d375 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.535761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1404/2836] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:44:36 2022] PUT /identity/v3/projects/36084886c904484f9964a9a1dbd03735/users/0dc625baeab54d09819628409bd437d3/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:36.545795 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b099ba7-8383-4941-adc6-ad0b0f19d340 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.546203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b099ba7-8383-4941-adc6-ad0b0f19d340 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.546650 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b099ba7-8383-4941-adc6-ad0b0f19d340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.572222 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2b099ba7-8383-4941-adc6-ad0b0f19d340 None None] MFA Rules not processed for user `0dc625baeab54d09819628409bd437d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:36.573406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2b099ba7-8383-4941-adc6-ad0b0f19d340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:36.634256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1433/2837] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:36.638992 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998f5bb-2012-49df-a690-f1c6fb00d375 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.697036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998f5bb-2012-49df-a690-f1c6fb00d375 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.701535 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b015b-3807-400e-a0c4-cc969ea83ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.702176 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b015b-3807-400e-a0c4-cc969ea83ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.702484 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b015b-3807-400e-a0c4-cc969ea83ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.702757 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b015b-3807-400e-a0c4-cc969ea83ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.703432 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b015b-3807-400e-a0c4-cc969ea83ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.705309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b015b-3807-400e-a0c4-cc969ea83ec5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.729146 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1405/2838] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:44:36 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:36.733132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b099ba7-8383-4941-adc6-ad0b0f19d340 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.743934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b099ba7-8383-4941-adc6-ad0b0f19d340 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.796652 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06025ff7-1396-4686-bebd-34196a0275ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.797307 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06025ff7-1396-4686-bebd-34196a0275ae admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.797584 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06025ff7-1396-4686-bebd-34196a0275ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.797853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06025ff7-1396-4686-bebd-34196a0275ae admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.798547 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06025ff7-1396-4686-bebd-34196a0275ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.800942 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06025ff7-1396-4686-bebd-34196a0275ae admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.820157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1434/2839] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:44:36 2022] POST /identity/v3/users => generated 296 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:36.824053 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b015b-3807-400e-a0c4-cc969ea83ec5 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.834126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b015b-3807-400e-a0c4-cc969ea83ec5 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.838761 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e2c22-4c13-41c9-bcad-e037636c1c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.839408 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e2c22-4c13-41c9-bcad-e037636c1c6c admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.839697 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e2c22-4c13-41c9-bcad-e037636c1c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.839971 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e2c22-4c13-41c9-bcad-e037636c1c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.840715 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e2c22-4c13-41c9-bcad-e037636c1c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.842309 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e2c22-4c13-41c9-bcad-e037636c1c6c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.852750 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1406/2840] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:44:36.856654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06025ff7-1396-4686-bebd-34196a0275ae admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.866804 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06025ff7-1396-4686-bebd-34196a0275ae admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.871304 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136aa8c-df32-42ee-8898-fbfc28499360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.872164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136aa8c-df32-42ee-8898-fbfc28499360 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.872443 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136aa8c-df32-42ee-8898-fbfc28499360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.872717 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136aa8c-df32-42ee-8898-fbfc28499360 admin admin] PATH_INFO: `/v3/projects/f50a32ca18264596b7bfc31fca2129eb/users/573e61c0a2f44bcca64d596d042fe143/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.888485 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136aa8c-df32-42ee-8898-fbfc28499360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50a32ca18264596b7bfc31fca2129eb, user_id=573e61c0a2f44bcca64d596d042fe143, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.891143 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136aa8c-df32-42ee-8898-fbfc28499360 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.903398 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1435/2841] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:44:36 2022] PUT /identity/v3/projects/f50a32ca18264596b7bfc31fca2129eb/users/573e61c0a2f44bcca64d596d042fe143/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:36.907159 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e2c22-4c13-41c9-bcad-e037636c1c6c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.916635 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e2c22-4c13-41c9-bcad-e037636c1c6c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:36.969631 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0da147-5bcf-4c7e-8e19-050555f084e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:36.970310 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0da147-5bcf-4c7e-8e19-050555f084e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:36.970594 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0da147-5bcf-4c7e-8e19-050555f084e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:36.970866 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0da147-5bcf-4c7e-8e19-050555f084e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:36.971576 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0da147-5bcf-4c7e-8e19-050555f084e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:36.973177 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0da147-5bcf-4c7e-8e19-050555f084e7 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:36.982415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1407/2842] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:44:36.986391 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136aa8c-df32-42ee-8898-fbfc28499360 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:36.996640 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136aa8c-df32-42ee-8898-fbfc28499360 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:37.001072 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6daa1-4a81-461c-b14e-182e93b82b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:37.001931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6daa1-4a81-461c-b14e-182e93b82b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:37.002206 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6daa1-4a81-461c-b14e-182e93b82b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:37.002579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6daa1-4a81-461c-b14e-182e93b82b99 admin admin] PATH_INFO: `/v3/projects/f50a32ca18264596b7bfc31fca2129eb/users/573e61c0a2f44bcca64d596d042fe143/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:37.005112 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6daa1-4a81-461c-b14e-182e93b82b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50a32ca18264596b7bfc31fca2129eb, user_id=573e61c0a2f44bcca64d596d042fe143, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:37.007709 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6daa1-4a81-461c-b14e-182e93b82b99 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:37.017569 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1436/2843] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:44:36 2022] PUT /identity/v3/projects/f50a32ca18264596b7bfc31fca2129eb/users/573e61c0a2f44bcca64d596d042fe143/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:37.027375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590222c1-df47-450d-8623-682ae4330a5e None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:37.027666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590222c1-df47-450d-8623-682ae4330a5e None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:37.027945 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590222c1-df47-450d-8623-682ae4330a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:37.054191 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-590222c1-df47-450d-8623-682ae4330a5e None None] MFA Rules not processed for user `573e61c0a2f44bcca64d596d042fe143`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:37.055433 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-590222c1-df47-450d-8623-682ae4330a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:37.118834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1408/2844] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:37.129746 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6daa1-4a81-461c-b14e-182e93b82b99 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:37.131414 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-98a6daa1-4a81-461c-b14e-182e93b82b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:37.185637 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6daa1-4a81-461c-b14e-182e93b82b99 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:37.189301 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2e91e-9bf7-405e-ae5a-f8dac8396653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:37.189927 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2e91e-9bf7-405e-ae5a-f8dac8396653 service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:37.190205 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2e91e-9bf7-405e-ae5a-f8dac8396653 service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:37.190586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2e91e-9bf7-405e-ae5a-f8dac8396653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:37.199199 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2e91e-9bf7-405e-ae5a-f8dac8396653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:37.200599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2e91e-9bf7-405e-ae5a-f8dac8396653 service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:37.209573 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1437/2845] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:44:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:44:37.279507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590222c1-df47-450d-8623-682ae4330a5e None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:37.288996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590222c1-df47-450d-8623-682ae4330a5e None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:37.292720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58424176-68a8-43e7-a58c-541308f37504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:37.293350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58424176-68a8-43e7-a58c-541308f37504 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:37.293630 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58424176-68a8-43e7-a58c-541308f37504 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:37.293904 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58424176-68a8-43e7-a58c-541308f37504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:37.349781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58424176-68a8-43e7-a58c-541308f37504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:37.351222 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58424176-68a8-43e7-a58c-541308f37504 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:37.360415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1409/2846] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:44:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:44:47.038074 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2e91e-9bf7-405e-ae5a-f8dac8396653 service cinder] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:47.096434 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2e91e-9bf7-405e-ae5a-f8dac8396653 service cinder] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:47.100908 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:47.101758 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:47.102039 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:47.102339 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] PATH_INFO: `/v3/users/0dc625baeab54d09819628409bd437d3` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:47.103532 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc625baeab54d09819628409bd437d3)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:47.105416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:47.148799 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc625baeab54d09819628409bd437d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.155287 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc625baeab54d09819628409bd437d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.162528 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc625baeab54d09819628409bd437d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.163156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc625baeab54d09819628409bd437d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.163755 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc625baeab54d09819628409bd437d3'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.179870 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1438/2847] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:44:47 2022] DELETE /identity/v3/users/0dc625baeab54d09819628409bd437d3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:47.184335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c422-848a-4c53-94f5-2f99291b9c2d None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:47.184824 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c422-848a-4c53-94f5-2f99291b9c2d None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:47.184967 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623c422-848a-4c53-94f5-2f99291b9c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:47.201226 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-d623c422-848a-4c53-94f5-2f99291b9c2d None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:47.202441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d623c422-848a-4c53-94f5-2f99291b9c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:47.259781 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1410/2848] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:47.269478 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:47.270931 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:47.325948 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249301ae-25d2-4463-964d-923c811f5641 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:47.329513 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7734cd6-20bb-49d5-b79b-031058b44925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:47.330149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7734cd6-20bb-49d5-b79b-031058b44925 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:47.330458 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7734cd6-20bb-49d5-b79b-031058b44925 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:47.330757 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7734cd6-20bb-49d5-b79b-031058b44925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:47.339401 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7734cd6-20bb-49d5-b79b-031058b44925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:47.340798 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7734cd6-20bb-49d5-b79b-031058b44925 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:47.349914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1439/2849] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:44:47.602601 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623c422-848a-4c53-94f5-2f99291b9c2d None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:47.604003 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-d623c422-848a-4c53-94f5-2f99291b9c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:47.616036 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623c422-848a-4c53-94f5-2f99291b9c2d None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:47.620503 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:47.621351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:47.621659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:47.621928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] PATH_INFO: `/v3/projects/36084886c904484f9964a9a1dbd03735` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:47.623385 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36084886c904484f9964a9a1dbd03735)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:47.625113 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:47.676636 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36084886c904484f9964a9a1dbd03735', 'request_id': 'req-49c9adcd-1392-402a-ae67-baa46fe78ef4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.682611 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36084886c904484f9964a9a1dbd03735', 'request_id': 'req-49c9adcd-1392-402a-ae67-baa46fe78ef4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.687822 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36084886c904484f9964a9a1dbd03735', 'request_id': 'req-49c9adcd-1392-402a-ae67-baa46fe78ef4'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.699839 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] The token cache is being invalidate because project 36084886c904484f9964a9a1dbd03735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:44:47.700119 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.700735 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.702375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1411/2850] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:44:47 2022] DELETE /identity/v3/projects/36084886c904484f9964a9a1dbd03735 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:47.706546 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7734cd6-20bb-49d5-b79b-031058b44925 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:47.715987 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7734cd6-20bb-49d5-b79b-031058b44925 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:47.772007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:47.772995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:47.773166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:47.773465 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] PATH_INFO: `/v3/users/573e61c0a2f44bcca64d596d042fe143` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:47.774679 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573e61c0a2f44bcca64d596d042fe143)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:47.776555 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:47.819860 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573e61c0a2f44bcca64d596d042fe143'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.826195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573e61c0a2f44bcca64d596d042fe143'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.832842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573e61c0a2f44bcca64d596d042fe143'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.833440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573e61c0a2f44bcca64d596d042fe143'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.834031 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-3c7f66a6-4c19-4e7e-b4d5-aaea58065387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573e61c0a2f44bcca64d596d042fe143'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:47.850410 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1440/2851] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:44:47 2022] DELETE /identity/v3/users/573e61c0a2f44bcca64d596d042fe143 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:48.103149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.104682 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:48.120077 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9adcd-1392-402a-ae67-baa46fe78ef4 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.173026 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.173863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.174141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.174441 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] PATH_INFO: `/v3/projects/f50a32ca18264596b7bfc31fca2129eb` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.176124 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50a32ca18264596b7bfc31fca2129eb)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.177996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.220543 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50a32ca18264596b7bfc31fca2129eb', 'request_id': 'req-4937a9f4-e1ba-452a-a1d2-d940e33603c1'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:48.226725 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50a32ca18264596b7bfc31fca2129eb', 'request_id': 'req-4937a9f4-e1ba-452a-a1d2-d940e33603c1'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:48.231823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50a32ca18264596b7bfc31fca2129eb', 'request_id': 'req-4937a9f4-e1ba-452a-a1d2-d940e33603c1'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:48.243112 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] The token cache is being invalidate because project f50a32ca18264596b7bfc31fca2129eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:44:48.243396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:48.244010 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-4937a9f4-e1ba-452a-a1d2-d940e33603c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:48.245507 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1412/2852] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:44:48 2022] DELETE /identity/v3/projects/f50a32ca18264596b7bfc31fca2129eb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:48.250426 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b7de-4355-43a9-9fd0-65390793e109 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.250914 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b7de-4355-43a9-9fd0-65390793e109 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.251033 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b7de-4355-43a9-9fd0-65390793e109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.269579 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-0e84b7de-4355-43a9-9fd0-65390793e109 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:48.270788 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-0e84b7de-4355-43a9-9fd0-65390793e109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:48.324201 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1441/2853] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:48.332377 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2ece-180f-4d15-b10e-473ac9b64ff6 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.332666 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2ece-180f-4d15-b10e-473ac9b64ff6 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.332942 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2ece-180f-4d15-b10e-473ac9b64ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.350807 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-b06b2ece-180f-4d15-b10e-473ac9b64ff6 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:48.352064 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-b06b2ece-180f-4d15-b10e-473ac9b64ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:48.360204 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1413/2854] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:48.364097 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84b7de-4355-43a9-9fd0-65390793e109 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.373267 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84b7de-4355-43a9-9fd0-65390793e109 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.377691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8829b2-50f4-4bbd-818f-69a82f63575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.378885 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8829b2-50f4-4bbd-818f-69a82f63575a admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.379164 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8829b2-50f4-4bbd-818f-69a82f63575a admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.379435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8829b2-50f4-4bbd-818f-69a82f63575a admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.380146 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8829b2-50f4-4bbd-818f-69a82f63575a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:44:48.380446 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8829b2-50f4-4bbd-818f-69a82f63575a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.382015 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8829b2-50f4-4bbd-818f-69a82f63575a admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.393453 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1442/2855] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:44:48.398167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2ece-180f-4d15-b10e-473ac9b64ff6 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.407174 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2ece-180f-4d15-b10e-473ac9b64ff6 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.411978 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521fad-a61f-488b-9274-cc753542d104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.412646 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521fad-a61f-488b-9274-cc753542d104 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.412928 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521fad-a61f-488b-9274-cc753542d104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.413207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521fad-a61f-488b-9274-cc753542d104 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.413888 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04521fad-a61f-488b-9274-cc753542d104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.415906 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04521fad-a61f-488b-9274-cc753542d104 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.441972 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1414/2856] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:44:48 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:48.445895 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8829b2-50f4-4bbd-818f-69a82f63575a admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.455419 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8829b2-50f4-4bbd-818f-69a82f63575a admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.508160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eaf82-0d38-48f9-9dec-45085681a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.508741 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eaf82-0d38-48f9-9dec-45085681a709 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.509021 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eaf82-0d38-48f9-9dec-45085681a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.509293 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eaf82-0d38-48f9-9dec-45085681a709 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.509959 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211eaf82-0d38-48f9-9dec-45085681a709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.512124 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211eaf82-0d38-48f9-9dec-45085681a709 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.530985 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1443/2857] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:44:48 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:48.535626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521fad-a61f-488b-9274-cc753542d104 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.545617 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521fad-a61f-488b-9274-cc753542d104 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.550882 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2be1a-4fea-4a1f-9490-956be35828a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.551535 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2be1a-4fea-4a1f-9490-956be35828a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.551823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2be1a-4fea-4a1f-9490-956be35828a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.552097 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2be1a-4fea-4a1f-9490-956be35828a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.552820 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2be1a-4fea-4a1f-9490-956be35828a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.554492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2be1a-4fea-4a1f-9490-956be35828a5 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.565294 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1415/2858] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:44:48.569224 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eaf82-0d38-48f9-9dec-45085681a709 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.578670 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eaf82-0d38-48f9-9dec-45085681a709 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.583203 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4d1c3-674d-42d2-b6d7-3ce42b43815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.583841 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4d1c3-674d-42d2-b6d7-3ce42b43815d admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.584122 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4d1c3-674d-42d2-b6d7-3ce42b43815d admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.584395 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4d1c3-674d-42d2-b6d7-3ce42b43815d admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.585104 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4d1c3-674d-42d2-b6d7-3ce42b43815d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.586710 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4d1c3-674d-42d2-b6d7-3ce42b43815d admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.596020 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1444/2859] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:44:48.600307 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2be1a-4fea-4a1f-9490-956be35828a5 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.610141 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2be1a-4fea-4a1f-9490-956be35828a5 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.614792 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f775-7e48-4a47-80d0-85f24c9d0c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.615648 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f775-7e48-4a47-80d0-85f24c9d0c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.615933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f775-7e48-4a47-80d0-85f24c9d0c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.616211 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f775-7e48-4a47-80d0-85f24c9d0c3a admin admin] PATH_INFO: `/v3/projects/a3ceb297897743c7ad38543805982a84/users/fd1ea5c487904231b395196c4b6f06c3/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.630205 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51f775-7e48-4a47-80d0-85f24c9d0c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ceb297897743c7ad38543805982a84, user_id=fd1ea5c487904231b395196c4b6f06c3, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.632842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51f775-7e48-4a47-80d0-85f24c9d0c3a admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.646223 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1416/2860] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:44:48 2022] PUT /identity/v3/projects/a3ceb297897743c7ad38543805982a84/users/fd1ea5c487904231b395196c4b6f06c3/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:48.656469 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09038b62-5380-48f2-bcc9-4751eda0fec4 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.656764 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09038b62-5380-48f2-bcc9-4751eda0fec4 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.657047 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09038b62-5380-48f2-bcc9-4751eda0fec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.683290 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-09038b62-5380-48f2-bcc9-4751eda0fec4 None None] MFA Rules not processed for user `fd1ea5c487904231b395196c4b6f06c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:48.684479 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-09038b62-5380-48f2-bcc9-4751eda0fec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:48.745774 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1445/2861] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:48.750288 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f775-7e48-4a47-80d0-85f24c9d0c3a admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.811134 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f775-7e48-4a47-80d0-85f24c9d0c3a admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.815659 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7af56-79d3-4417-ad1d-fcd1538e1c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.816344 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7af56-79d3-4417-ad1d-fcd1538e1c37 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.816626 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7af56-79d3-4417-ad1d-fcd1538e1c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.816925 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7af56-79d3-4417-ad1d-fcd1538e1c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.817592 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7af56-79d3-4417-ad1d-fcd1538e1c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.819523 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7af56-79d3-4417-ad1d-fcd1538e1c37 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.843055 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1417/2862] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:44:48 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:48.847367 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09038b62-5380-48f2-bcc9-4751eda0fec4 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.858362 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09038b62-5380-48f2-bcc9-4751eda0fec4 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.913975 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dc746-9bc1-49c0-a36d-a5ab21398bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.914675 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dc746-9bc1-49c0-a36d-a5ab21398bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.914955 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dc746-9bc1-49c0-a36d-a5ab21398bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.915223 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dc746-9bc1-49c0-a36d-a5ab21398bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.915898 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dc746-9bc1-49c0-a36d-a5ab21398bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.917770 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4dc746-9bc1-49c0-a36d-a5ab21398bc0 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.936297 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1446/2863] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:44:48 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:48.940207 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7af56-79d3-4417-ad1d-fcd1538e1c37 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.950050 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7af56-79d3-4417-ad1d-fcd1538e1c37 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.954677 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf67b13-70e9-4282-9574-e1f79bef2a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.955324 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67b13-70e9-4282-9574-e1f79bef2a4c admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.955603 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67b13-70e9-4282-9574-e1f79bef2a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.955875 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67b13-70e9-4282-9574-e1f79bef2a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:48.957104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf67b13-70e9-4282-9574-e1f79bef2a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:48.958713 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf67b13-70e9-4282-9574-e1f79bef2a4c admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:48.968929 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1418/2864] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:44:48.973622 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dc746-9bc1-49c0-a36d-a5ab21398bc0 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:48.984438 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dc746-9bc1-49c0-a36d-a5ab21398bc0 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:48.989238 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cece07-8f77-4159-af91-72a78f4c8e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:48.990120 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cece07-8f77-4159-af91-72a78f4c8e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:48.990442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cece07-8f77-4159-af91-72a78f4c8e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:48.990723 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cece07-8f77-4159-af91-72a78f4c8e73 admin admin] PATH_INFO: `/v3/projects/2598ea4e70474aa694fea4ff6a330ddf/users/db54018a3ee0444b8069220210260a9d/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:49.006207 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cece07-8f77-4159-af91-72a78f4c8e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2598ea4e70474aa694fea4ff6a330ddf, user_id=db54018a3ee0444b8069220210260a9d, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:49.008880 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cece07-8f77-4159-af91-72a78f4c8e73 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:49.022088 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1447/2865] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:44:48 2022] PUT /identity/v3/projects/2598ea4e70474aa694fea4ff6a330ddf/users/db54018a3ee0444b8069220210260a9d/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:49.025962 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf67b13-70e9-4282-9574-e1f79bef2a4c admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:49.035687 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf67b13-70e9-4282-9574-e1f79bef2a4c admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:49.088393 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd37d53-f734-487c-9342-b22151e982b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:49.089044 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd37d53-f734-487c-9342-b22151e982b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:49.089326 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd37d53-f734-487c-9342-b22151e982b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:49.089600 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd37d53-f734-487c-9342-b22151e982b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:49.090338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd37d53-f734-487c-9342-b22151e982b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:49.091917 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd37d53-f734-487c-9342-b22151e982b0 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:49.101105 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1419/2866] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:44:49.105121 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cece07-8f77-4159-af91-72a78f4c8e73 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:49.115156 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cece07-8f77-4159-af91-72a78f4c8e73 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:49.119785 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12d9e5-b56e-46da-abb3-cd7024165977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:49.120657 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12d9e5-b56e-46da-abb3-cd7024165977 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:49.120944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12d9e5-b56e-46da-abb3-cd7024165977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:49.121220 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12d9e5-b56e-46da-abb3-cd7024165977 admin admin] PATH_INFO: `/v3/projects/2598ea4e70474aa694fea4ff6a330ddf/users/db54018a3ee0444b8069220210260a9d/roles/f0208c43117c4b799194c83781a46e09` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:49.123231 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12d9e5-b56e-46da-abb3-cd7024165977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2598ea4e70474aa694fea4ff6a330ddf, user_id=db54018a3ee0444b8069220210260a9d, role_id=f0208c43117c4b799194c83781a46e09)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:49.125834 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12d9e5-b56e-46da-abb3-cd7024165977 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:49.136273 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1448/2867] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:44:49 2022] PUT /identity/v3/projects/2598ea4e70474aa694fea4ff6a330ddf/users/db54018a3ee0444b8069220210260a9d/roles/f0208c43117c4b799194c83781a46e09 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:49.196415 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290dd51-1ee0-4380-8325-aa6d9b3f3685 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:49.196703 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290dd51-1ee0-4380-8325-aa6d9b3f3685 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:49.196980 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290dd51-1ee0-4380-8325-aa6d9b3f3685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:49.222800 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-e290dd51-1ee0-4380-8325-aa6d9b3f3685 None None] MFA Rules not processed for user `db54018a3ee0444b8069220210260a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:49.223986 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-e290dd51-1ee0-4380-8325-aa6d9b3f3685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:49.287769 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1420/2868] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:49.298798 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12d9e5-b56e-46da-abb3-cd7024165977 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:49.301190 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9a12d9e5-b56e-46da-abb3-cd7024165977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:49.355586 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12d9e5-b56e-46da-abb3-cd7024165977 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:49.359154 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0280b08-9be9-4c5a-9c64-fab6a9930d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:49.359783 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0280b08-9be9-4c5a-9c64-fab6a9930d8c service cinder] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:49.360063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0280b08-9be9-4c5a-9c64-fab6a9930d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:49.360336 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0280b08-9be9-4c5a-9c64-fab6a9930d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:49.369429 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0280b08-9be9-4c5a-9c64-fab6a9930d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:49.370882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0280b08-9be9-4c5a-9c64-fab6a9930d8c service cinder] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:49.379863 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1449/2869] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:44:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:44:49.732370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290dd51-1ee0-4380-8325-aa6d9b3f3685 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:49.793170 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290dd51-1ee0-4380-8325-aa6d9b3f3685 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:49.797492 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:49.798373 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:49.798650 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:49.798919 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] PATH_INFO: `/v3/users/fd1ea5c487904231b395196c4b6f06c3` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:49.800143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1ea5c487904231b395196c4b6f06c3)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:49.802046 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:49.843965 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1ea5c487904231b395196c4b6f06c3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:49.850858 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1ea5c487904231b395196c4b6f06c3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:49.857527 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1ea5c487904231b395196c4b6f06c3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:49.858351 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1ea5c487904231b395196c4b6f06c3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:49.859104 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1ea5c487904231b395196c4b6f06c3'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:49.875362 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1421/2870] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:44:49 2022] DELETE /identity/v3/users/fd1ea5c487904231b395196c4b6f06c3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:49.880332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0fdfb-cd8f-4e87-9046-4f2367e7f611 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:49.880627 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0fdfb-cd8f-4e87-9046-4f2367e7f611 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:49.880900 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0fdfb-cd8f-4e87-9046-4f2367e7f611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:49.898036 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-feb0fdfb-cd8f-4e87-9046-4f2367e7f611 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:49.899256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-feb0fdfb-cd8f-4e87-9046-4f2367e7f611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:49.955779 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1450/2871] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:49.965237 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:49.966669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:50.020934 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bfb05-dd08-425f-9aa4-24ee4ff8c94b admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:50.024508 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dff9d-72c7-4d22-85a9-81c05fe8a48a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:50.025143 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dff9d-72c7-4d22-85a9-81c05fe8a48a service neutron] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:50.025420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dff9d-72c7-4d22-85a9-81c05fe8a48a service neutron] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:50.025689 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dff9d-72c7-4d22-85a9-81c05fe8a48a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:50.034992 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dff9d-72c7-4d22-85a9-81c05fe8a48a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:50.036403 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dff9d-72c7-4d22-85a9-81c05fe8a48a service neutron] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:50.045504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1422/2872] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:44:50.304565 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0fdfb-cd8f-4e87-9046-4f2367e7f611 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:50.305982 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-feb0fdfb-cd8f-4e87-9046-4f2367e7f611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:50.317882 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0fdfb-cd8f-4e87-9046-4f2367e7f611 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:50.322716 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:50.323855 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:50.324166 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:50.324440 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] PATH_INFO: `/v3/projects/a3ceb297897743c7ad38543805982a84` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:50.325606 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ceb297897743c7ad38543805982a84)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:50.327690 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:50.374188 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ceb297897743c7ad38543805982a84', 'request_id': 'req-5b5fc80e-619b-49b7-9f50-db9adfb96efc'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.381995 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ceb297897743c7ad38543805982a84', 'request_id': 'req-5b5fc80e-619b-49b7-9f50-db9adfb96efc'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.388408 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ceb297897743c7ad38543805982a84', 'request_id': 'req-5b5fc80e-619b-49b7-9f50-db9adfb96efc'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.398922 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] The token cache is being invalidate because project a3ceb297897743c7ad38543805982a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:44:50.399214 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.399844 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.401387 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1451/2873] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:44:50 2022] DELETE /identity/v3/projects/a3ceb297897743c7ad38543805982a84 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:50.405340 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dff9d-72c7-4d22-85a9-81c05fe8a48a service neutron] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:50.415290 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dff9d-72c7-4d22-85a9-81c05fe8a48a service neutron] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:50.468579 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:50.469436 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:50.469720 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:50.469996 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] PATH_INFO: `/v3/users/db54018a3ee0444b8069220210260a9d` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:50.471199 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db54018a3ee0444b8069220210260a9d)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:50.473106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:50.517349 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db54018a3ee0444b8069220210260a9d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.523791 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db54018a3ee0444b8069220210260a9d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.530352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db54018a3ee0444b8069220210260a9d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.530973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db54018a3ee0444b8069220210260a9d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.531571 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-0ed50b8a-1f36-405e-9cce-faf07e5768b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db54018a3ee0444b8069220210260a9d'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.548454 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1423/2874] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:44:50 2022] DELETE /identity/v3/users/db54018a3ee0444b8069220210260a9d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:50.805161 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:50.806601 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:50.819700 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc80e-619b-49b7-9f50-db9adfb96efc admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:50.874537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:50.875360 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:50.875638 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:50.875904 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] PATH_INFO: `/v3/projects/2598ea4e70474aa694fea4ff6a330ddf` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:50.877058 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=2598ea4e70474aa694fea4ff6a330ddf)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:50.879600 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:50.921551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2598ea4e70474aa694fea4ff6a330ddf', 'request_id': 'req-ae5f34cc-2591-490b-aac1-b930c962b7af'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.928933 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2598ea4e70474aa694fea4ff6a330ddf', 'request_id': 'req-ae5f34cc-2591-490b-aac1-b930c962b7af'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.934936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2598ea4e70474aa694fea4ff6a330ddf', 'request_id': 'req-ae5f34cc-2591-490b-aac1-b930c962b7af'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.944520 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] The token cache is being invalidate because project 2598ea4e70474aa694fea4ff6a330ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86100) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:44:50.944803 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.945418 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-ae5f34cc-2591-490b-aac1-b930c962b7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:44:50.946944 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1452/2875] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:44:50 2022] DELETE /identity/v3/projects/2598ea4e70474aa694fea4ff6a330ddf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:50.952654 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25228873-55dc-4fcf-a004-da24599f1625 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:50.952946 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25228873-55dc-4fcf-a004-da24599f1625 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:50.953225 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25228873-55dc-4fcf-a004-da24599f1625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:50.971702 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-25228873-55dc-4fcf-a004-da24599f1625 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:50.972940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-25228873-55dc-4fcf-a004-da24599f1625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:51.028810 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1424/2876] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:44:51.036599 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872960a9-d36a-4ce7-b87c-09b1874ccf00 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:51.036889 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872960a9-d36a-4ce7-b87c-09b1874ccf00 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:51.037169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872960a9-d36a-4ce7-b87c-09b1874ccf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:51.055312 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-872960a9-d36a-4ce7-b87c-09b1874ccf00 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:51.056432 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-872960a9-d36a-4ce7-b87c-09b1874ccf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:51.064076 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1453/2877] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:51.068615 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25228873-55dc-4fcf-a004-da24599f1625 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:51.077889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25228873-55dc-4fcf-a004-da24599f1625 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:51.082445 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339b252-8b0b-4d42-87cd-75a3dd91f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:51.083090 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339b252-8b0b-4d42-87cd-75a3dd91f157 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:51.083370 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339b252-8b0b-4d42-87cd-75a3dd91f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:51.083639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339b252-8b0b-4d42-87cd-75a3dd91f157 admin admin] PATH_INFO: `/v3/domains` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:51.084352 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339b252-8b0b-4d42-87cd-75a3dd91f157 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:44:51.084652 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339b252-8b0b-4d42-87cd-75a3dd91f157 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:51.086224 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339b252-8b0b-4d42-87cd-75a3dd91f157 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:51.097167 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1425/2878] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:44:51.101277 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872960a9-d36a-4ce7-b87c-09b1874ccf00 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:51.110149 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872960a9-d36a-4ce7-b87c-09b1874ccf00 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:51.115289 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224373-8136-461f-b08e-7d823fc3e4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:51.115934 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224373-8136-461f-b08e-7d823fc3e4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:51.116216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224373-8136-461f-b08e-7d823fc3e4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:51.116488 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1224373-8136-461f-b08e-7d823fc3e4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:51.117169 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1224373-8136-461f-b08e-7d823fc3e4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:51.119063 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1224373-8136-461f-b08e-7d823fc3e4b1 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:51.148209 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1454/2879] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:44:51 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:51.152479 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339b252-8b0b-4d42-87cd-75a3dd91f157 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:51.162698 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339b252-8b0b-4d42-87cd-75a3dd91f157 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:51.215704 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9522c7-e04e-4bcf-a044-621bd37d3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:51.216357 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9522c7-e04e-4bcf-a044-621bd37d3c83 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:51.216637 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9522c7-e04e-4bcf-a044-621bd37d3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:51.216911 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9522c7-e04e-4bcf-a044-621bd37d3c83 admin admin] PATH_INFO: `/v3/users` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:51.217580 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9522c7-e04e-4bcf-a044-621bd37d3c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:51.219502 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9522c7-e04e-4bcf-a044-621bd37d3c83 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:51.239227 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1426/2880] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:44:51 2022] POST /identity/v3/users => generated 285 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:44:51.243348 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224373-8136-461f-b08e-7d823fc3e4b1 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:51.253853 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1224373-8136-461f-b08e-7d823fc3e4b1 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:51.258400 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8b5cb-d898-4c09-a862-a3ab36086d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:51.259051 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b5cb-d898-4c09-a862-a3ab36086d15 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:51.259334 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b5cb-d898-4c09-a862-a3ab36086d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:51.259608 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b5cb-d898-4c09-a862-a3ab36086d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:51.260326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8b5cb-d898-4c09-a862-a3ab36086d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:51.262157 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8b5cb-d898-4c09-a862-a3ab36086d15 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:51.272691 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1455/2881] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:44:51.276610 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9522c7-e04e-4bcf-a044-621bd37d3c83 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:51.286353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9522c7-e04e-4bcf-a044-621bd37d3c83 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:51.290933 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2d8d-0f1d-419a-b982-4234017f6240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:51.291577 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2d8d-0f1d-419a-b982-4234017f6240 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:51.291863 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2d8d-0f1d-419a-b982-4234017f6240 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:51.292142 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2d8d-0f1d-419a-b982-4234017f6240 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:51.292859 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2d8d-0f1d-419a-b982-4234017f6240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:51.294477 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2d8d-0f1d-419a-b982-4234017f6240 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:51.304742 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1427/2882] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:44:51.308735 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8b5cb-d898-4c09-a862-a3ab36086d15 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:51.318616 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8b5cb-d898-4c09-a862-a3ab36086d15 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:51.323090 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0dd1b-94dd-4291-b53f-d913f7eac048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:51.323940 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0dd1b-94dd-4291-b53f-d913f7eac048 admin admin] REQUEST_METHOD: `PUT` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:51.324216 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0dd1b-94dd-4291-b53f-d913f7eac048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:51.324487 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0dd1b-94dd-4291-b53f-d913f7eac048 admin admin] PATH_INFO: `/v3/projects/92a2205b001246af945530101d3626bf/users/9572037a6edf4f10a604cbae2423ecad/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:51.338847 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0dd1b-94dd-4291-b53f-d913f7eac048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a2205b001246af945530101d3626bf, user_id=9572037a6edf4f10a604cbae2423ecad, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:51.341484 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be0dd1b-94dd-4291-b53f-d913f7eac048 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:51.353563 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1456/2883] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:44:51 2022] PUT /identity/v3/projects/92a2205b001246af945530101d3626bf/users/9572037a6edf4f10a604cbae2423ecad/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:44:51.363524 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1927e49-2656-4e07-a17a-58b02671efca None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:51.363842 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1927e49-2656-4e07-a17a-58b02671efca None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:51.364147 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1927e49-2656-4e07-a17a-58b02671efca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:51.389723 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-f1927e49-2656-4e07-a17a-58b02671efca None None] MFA Rules not processed for user `9572037a6edf4f10a604cbae2423ecad`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:44:51.390927 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f1927e49-2656-4e07-a17a-58b02671efca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:51.450504 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1428/2884] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:44:51.462180 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0dd1b-94dd-4291-b53f-d913f7eac048 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:44:51.463921 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-9be0dd1b-94dd-4291-b53f-d913f7eac048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:44:51.537760 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be0dd1b-94dd-4291-b53f-d913f7eac048 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:44:51.541345 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d244af-64fb-4e04-8acc-85896c28901f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaf01f45e7a429e9361eb176a3f7c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:44:51.541980 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d244af-64fb-4e04-8acc-85896c28901f service glance] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:44:51.542285 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d244af-64fb-4e04-8acc-85896c28901f service glance] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:44:51.542568 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d244af-64fb-4e04-8acc-85896c28901f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:44:51.551102 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d244af-64fb-4e04-8acc-85896c28901f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:44:51.552512 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d244af-64fb-4e04-8acc-85896c28901f service glance] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:44:51.561059 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1457/2885] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:44:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:45:03.538867 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1927e49-2656-4e07-a17a-58b02671efca None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:03.540273 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-f1927e49-2656-4e07-a17a-58b02671efca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:03.606831 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1927e49-2656-4e07-a17a-58b02671efca None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:03.611717 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9a43d-a3cc-461d-9f2d-a637181bdb6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92588782f32a472193340aba2bff8d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:03.612940 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9a43d-a3cc-461d-9f2d-a637181bdb6f service placement] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:03.613223 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9a43d-a3cc-461d-9f2d-a637181bdb6f service placement] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:03.613496 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9a43d-a3cc-461d-9f2d-a637181bdb6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:03.615286 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-c5b9a43d-a3cc-461d-9f2d-a637181bdb6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:03.626330 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9a43d-a3cc-461d-9f2d-a637181bdb6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:03.627907 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9a43d-a3cc-461d-9f2d-a637181bdb6f service placement] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:03.637759 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1429/2886] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:45:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:45:21.132773 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d244af-64fb-4e04-8acc-85896c28901f service glance] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:21.192280 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d244af-64fb-4e04-8acc-85896c28901f service glance] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:21.196707 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:21.197558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:21.197837 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:21.198105 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] PATH_INFO: `/v3/users/9572037a6edf4f10a604cbae2423ecad` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:21.199283 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9572037a6edf4f10a604cbae2423ecad)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:21.201159 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:21.243850 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9572037a6edf4f10a604cbae2423ecad'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.250298 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9572037a6edf4f10a604cbae2423ecad'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.257935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9572037a6edf4f10a604cbae2423ecad'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.258562 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9572037a6edf4f10a604cbae2423ecad'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.259160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9572037a6edf4f10a604cbae2423ecad'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.275497 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1458/2887] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:45:21 2022] DELETE /identity/v3/users/9572037a6edf4f10a604cbae2423ecad => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:45:21.279889 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e98506-ecb5-4086-894f-408e8420ccb7 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:21.280388 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e98506-ecb5-4086-894f-408e8420ccb7 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:21.280506 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e98506-ecb5-4086-894f-408e8420ccb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:21.299041 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-55e98506-ecb5-4086-894f-408e8420ccb7 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:45:21.300816 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-55e98506-ecb5-4086-894f-408e8420ccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:21.356627 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1430/2888] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:45:21.366196 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:21.367537 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:21.422668 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ff163-6da1-47c1-857a-ef340aca254c admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:21.426226 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be83a01-a14b-42cd-873d-5caad03cd2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:21.426887 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be83a01-a14b-42cd-873d-5caad03cd2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:21.427165 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be83a01-a14b-42cd-873d-5caad03cd2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:21.427435 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be83a01-a14b-42cd-873d-5caad03cd2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:21.436246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be83a01-a14b-42cd-873d-5caad03cd2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:21.437656 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be83a01-a14b-42cd-873d-5caad03cd2d7 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:21.447464 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1459/2889] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:45:21.701639 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e98506-ecb5-4086-894f-408e8420ccb7 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:21.703209 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-55e98506-ecb5-4086-894f-408e8420ccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:21.717059 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e98506-ecb5-4086-894f-408e8420ccb7 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:21.722168 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:21.723106 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:21.723382 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:21.723650 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] PATH_INFO: `/v3/projects/92a2205b001246af945530101d3626bf` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:21.724834 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a2205b001246af945530101d3626bf)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:21.726762 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:21.772283 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a2205b001246af945530101d3626bf', 'request_id': 'req-87bdfae1-2603-429e-815a-ddcc1db6dd99'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.777991 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a2205b001246af945530101d3626bf', 'request_id': 'req-87bdfae1-2603-429e-815a-ddcc1db6dd99'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.783075 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a2205b001246af945530101d3626bf', 'request_id': 'req-87bdfae1-2603-429e-815a-ddcc1db6dd99'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.794994 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] The token cache is being invalidate because project 92a2205b001246af945530101d3626bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:45:21.795275 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.795880 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-87bdfae1-2603-429e-815a-ddcc1db6dd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:21.797375 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1431/2890] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:45:21 2022] DELETE /identity/v3/projects/92a2205b001246af945530101d3626bf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:45:21.802843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603e2d3-dd02-4a2c-85e6-99f42e4dab5c None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:21.803132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603e2d3-dd02-4a2c-85e6-99f42e4dab5c None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:21.803407 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603e2d3-dd02-4a2c-85e6-99f42e4dab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:21.820667 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-2603e2d3-dd02-4a2c-85e6-99f42e4dab5c None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:45:21.821840 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-2603e2d3-dd02-4a2c-85e6-99f42e4dab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:21.877299 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1460/2891] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:45:21.885676 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882e2fa-ef6a-40e4-87fc-ac7e9194c615 None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:21.885949 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882e2fa-ef6a-40e4-87fc-ac7e9194c615 None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:21.886228 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882e2fa-ef6a-40e4-87fc-ac7e9194c615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:21.905748 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-9882e2fa-ef6a-40e4-87fc-ac7e9194c615 None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:45:21.906998 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-9882e2fa-ef6a-40e4-87fc-ac7e9194c615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:21.915338 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1432/2892] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:45:21.919587 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603e2d3-dd02-4a2c-85e6-99f42e4dab5c None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:21.930551 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603e2d3-dd02-4a2c-85e6-99f42e4dab5c None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:21.935256 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136fc89-3832-4aa3-8ea3-f3be871affb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:21.936132 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136fc89-3832-4aa3-8ea3-f3be871affb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:21.936416 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136fc89-3832-4aa3-8ea3-f3be871affb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:21.936686 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136fc89-3832-4aa3-8ea3-f3be871affb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:21.937428 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136fc89-3832-4aa3-8ea3-f3be871affb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86100) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:45:21.937730 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136fc89-3832-4aa3-8ea3-f3be871affb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:21.939388 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136fc89-3832-4aa3-8ea3-f3be871affb7 admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:21.952332 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1461/2893] 10.222.0.32 () {58 vars in 1152 bytes} [Tue Apr 12 00:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:45:21.957335 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882e2fa-ef6a-40e4-87fc-ac7e9194c615 None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:21.967684 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882e2fa-ef6a-40e4-87fc-ac7e9194c615 None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:21.972808 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b85a9-3fcc-4732-acdd-4b9c7f51d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:21.973586 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b85a9-3fcc-4732-acdd-4b9c7f51d572 admin admin] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:21.973935 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b85a9-3fcc-4732-acdd-4b9c7f51d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:21.974317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b85a9-3fcc-4732-acdd-4b9c7f51d572 admin admin] PATH_INFO: `/v3/projects` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:21.975095 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b85a9-3fcc-4732-acdd-4b9c7f51d572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:21.977152 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b85a9-3fcc-4732-acdd-4b9c7f51d572 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:22.007420 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1433/2894] 10.222.0.32 () {60 vars in 1152 bytes} [Tue Apr 12 00:45:21 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:45:22.008647 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136fc89-3832-4aa3-8ea3-f3be871affb7 admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:22.020910 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136fc89-3832-4aa3-8ea3-f3be871affb7 admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:22.075246 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9556b7-2bf2-4220-b878-bac264f2a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:22.075916 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9556b7-2bf2-4220-b878-bac264f2a5fb admin admin] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:22.076197 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9556b7-2bf2-4220-b878-bac264f2a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:22.076474 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9556b7-2bf2-4220-b878-bac264f2a5fb admin admin] PATH_INFO: `/v3/users` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:22.077151 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9556b7-2bf2-4220-b878-bac264f2a5fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:22.079081 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9556b7-2bf2-4220-b878-bac264f2a5fb admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:22.098040 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1462/2895] 10.222.0.32 () {60 vars in 1143 bytes} [Tue Apr 12 00:45:22 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:45:22.102187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b85a9-3fcc-4732-acdd-4b9c7f51d572 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:22.112043 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b85a9-3fcc-4732-acdd-4b9c7f51d572 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:22.116534 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99952e7-f86b-41b6-8928-e68b35796d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:22.117187 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99952e7-f86b-41b6-8928-e68b35796d55 admin admin] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:22.117466 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99952e7-f86b-41b6-8928-e68b35796d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:22.117739 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99952e7-f86b-41b6-8928-e68b35796d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:22.118511 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99952e7-f86b-41b6-8928-e68b35796d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:22.120076 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99952e7-f86b-41b6-8928-e68b35796d55 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:22.130521 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1434/2896] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:45:22.134093 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9556b7-2bf2-4220-b878-bac264f2a5fb admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:22.144654 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9556b7-2bf2-4220-b878-bac264f2a5fb admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:22.149195 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997af4ff-4198-4186-9c20-4b3834705d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:22.149842 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997af4ff-4198-4186-9c20-4b3834705d4c admin admin] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:22.150127 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997af4ff-4198-4186-9c20-4b3834705d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:22.150442 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997af4ff-4198-4186-9c20-4b3834705d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:22.151160 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997af4ff-4198-4186-9c20-4b3834705d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:22.152726 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997af4ff-4198-4186-9c20-4b3834705d4c admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:22.162148 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1463/2897] 10.222.0.32 () {58 vars in 1121 bytes} [Tue Apr 12 00:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:45:22.165894 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99952e7-f86b-41b6-8928-e68b35796d55 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:22.175353 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99952e7-f86b-41b6-8928-e68b35796d55 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:22.179823 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8f14-46d9-4b9a-aafb-14034a93a9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:22.180672 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8f14-46d9-4b9a-aafb-14034a93a9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:22.180948 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8f14-46d9-4b9a-aafb-14034a93a9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:22.181215 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d8f14-46d9-4b9a-aafb-14034a93a9c8 admin admin] PATH_INFO: `/v3/projects/10c2a9666ead4be9863f094f6b2ef8d1/users/aa9d5f5d56f049f3ac0f072646044874/roles/7277e8dc4e284e59a5f04f5183b5c341` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:22.195707 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8f14-46d9-4b9a-aafb-14034a93a9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c2a9666ead4be9863f094f6b2ef8d1, user_id=aa9d5f5d56f049f3ac0f072646044874, role_id=7277e8dc4e284e59a5f04f5183b5c341)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:22.198329 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d8f14-46d9-4b9a-aafb-14034a93a9c8 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:22.211130 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1435/2898] 10.222.0.32 () {60 vars in 1482 bytes} [Tue Apr 12 00:45:22 2022] PUT /identity/v3/projects/10c2a9666ead4be9863f094f6b2ef8d1/users/aa9d5f5d56f049f3ac0f072646044874/roles/7277e8dc4e284e59a5f04f5183b5c341 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:45:22.221326 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cc532-b75f-4dc4-8974-78c438e6dbd9 None None] REQUEST_METHOD: `POST` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:22.221618 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cc532-b75f-4dc4-8974-78c438e6dbd9 None None] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:22.221936 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cc532-b75f-4dc4-8974-78c438e6dbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:22.247066 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.auth.core [None req-589cc532-b75f-4dc4-8974-78c438e6dbd9 None None] MFA Rules not processed for user `aa9d5f5d56f049f3ac0f072646044874`. Rule list: `[]` (Enabled: `True`). {{(pid=86100) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:45:22.248252 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-589cc532-b75f-4dc4-8974-78c438e6dbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:22.311444 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1464/2899] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:45:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:45:22.322910 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8f14-46d9-4b9a-aafb-14034a93a9c8 admin admin] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:22.324662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-346d8f14-46d9-4b9a-aafb-14034a93a9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:22.380447 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d8f14-46d9-4b9a-aafb-14034a93a9c8 admin admin] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:22.384160 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db851b-1fc7-4bc2-962d-b31689bbb8b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73a39479834440ffa85fbc0d58a257d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:22.384751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db851b-1fc7-4bc2-962d-b31689bbb8b0 service cinder] REQUEST_METHOD: `GET` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:22.385037 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db851b-1fc7-4bc2-962d-b31689bbb8b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:22.385317 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db851b-1fc7-4bc2-962d-b31689bbb8b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:22.394210 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db851b-1fc7-4bc2-962d-b31689bbb8b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:22.395662 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8db851b-1fc7-4bc2-962d-b31689bbb8b0 service cinder] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:22.404431 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1436/2900] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:45:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:45:30.378688 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cc532-b75f-4dc4-8974-78c438e6dbd9 None None] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:30.437406 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cc532-b75f-4dc4-8974-78c438e6dbd9 None None] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:30.441935 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:30.442815 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:30.443099 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:30.443373 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] PATH_INFO: `/v3/users/aa9d5f5d56f049f3ac0f072646044874` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:30.444535 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9d5f5d56f049f3ac0f072646044874)` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:30.446460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:30.488744 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9d5f5d56f049f3ac0f072646044874'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:30.495393 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9d5f5d56f049f3ac0f072646044874'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:30.502027 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9d5f5d56f049f3ac0f072646044874'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:30.502702 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9d5f5d56f049f3ac0f072646044874'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:30.503281 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.notifications [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9d5f5d56f049f3ac0f072646044874'} {{(pid=86100) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:30.519557 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1465/2901] 10.222.0.32 () {58 vars in 1223 bytes} [Tue Apr 12 00:45:30 2022] DELETE /identity/v3/users/aa9d5f5d56f049f3ac0f072646044874 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:45:30.523973 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf6c84-95e5-400d-8a93-58575b80e0fc None None] REQUEST_METHOD: `POST` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:30.524453 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf6c84-95e5-400d-8a93-58575b80e0fc None None] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:30.524556 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf6c84-95e5-400d-8a93-58575b80e0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:30.541350 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.auth.core [None req-2bbf6c84-95e5-400d-8a93-58575b80e0fc None None] MFA Rules not processed for user `674ef23c54a243f3842909c6f536a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=86099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:45:30.542551 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2bbf6c84-95e5-400d-8a93-58575b80e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:30.597068 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1437/2902] 10.222.0.32 () {58 vars in 957 bytes} [Tue Apr 12 00:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:45:30.606503 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:30.607912 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:30.663002 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e75b54d-81cd-4920-b8b2-eea5eedefbfe admin admin] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:30.666628 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6c438-def2-4db3-966a-b961415aa997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a99a9951d83446efbf819b72836afc2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:30.667275 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6c438-def2-4db3-966a-b961415aa997 service neutron] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:30.667558 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6c438-def2-4db3-966a-b961415aa997 service neutron] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:30.667831 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6c438-def2-4db3-966a-b961415aa997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:30.676862 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6c438-def2-4db3-966a-b961415aa997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:30.678306 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6c438-def2-4db3-966a-b961415aa997 service neutron] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:30.687425 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1466/2903] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:45:30.942599 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf6c84-95e5-400d-8a93-58575b80e0fc None None] Authenticating user token {{(pid=86099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:45:30.944004 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.fernet_utils [None req-2bbf6c84-95e5-400d-8a93-58575b80e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:45:30.955716 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf6c84-95e5-400d-8a93-58575b80e0fc None None] Validating token access rules against request {{(pid=86099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:45:30.960254 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674ef23c54a243f3842909c6f536a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd9f2f2aa4034c3fa25d211a3bd7ce30', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:45:30.961126 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:45:30.961396 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:45:30.961669 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] PATH_INFO: `/v3/projects/10c2a9666ead4be9863f094f6b2ef8d1` {{(pid=86099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:45:30.962890 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c2a9666ead4be9863f094f6b2ef8d1)` {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:45:30.964772 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] RBAC: Authorization granted {{(pid=86099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:45:31.009034 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c2a9666ead4be9863f094f6b2ef8d1', 'request_id': 'req-857db448-3f07-45e1-917b-889d7270fb80'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:31.015149 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c2a9666ead4be9863f094f6b2ef8d1', 'request_id': 'req-857db448-3f07-45e1-917b-889d7270fb80'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:31.020304 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c2a9666ead4be9863f094f6b2ef8d1', 'request_id': 'req-857db448-3f07-45e1-917b-889d7270fb80'} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:31.031854 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] The token cache is being invalidate because project 10c2a9666ead4be9863f094f6b2ef8d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:45:31.032142 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:31.032751 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: DEBUG keystone.notifications [None req-857db448-3f07-45e1-917b-889d7270fb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:45:31.035018 dv-cinder-836252-3-iscsi devstack@keystone.service[86099]: [pid: 86099|app: 0|req: 1438/2904] 10.222.0.32 () {58 vars in 1232 bytes} [Tue Apr 12 00:45:30 2022] DELETE /identity/v3/projects/10c2a9666ead4be9863f094f6b2ef8d1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:50:07.453007 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6c438-def2-4db3-966a-b961415aa997 service neutron] Authenticating user token {{(pid=86100) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:50:07.454460 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-1ca6c438-def2-4db3-966a-b961415aa997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:50:07.585492 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6c438-def2-4db3-966a-b961415aa997 service neutron] Validating token access rules against request {{(pid=86100) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:50:07.640858 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb35131-578d-4795-9a5f-c72fe93fd287 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92588782f32a472193340aba2bff8d78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b37e79901c4d73b569b38bf7851db6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86100) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:50:07.641498 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb35131-578d-4795-9a5f-c72fe93fd287 service placement] REQUEST_METHOD: `GET` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:50:07.641781 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb35131-578d-4795-9a5f-c72fe93fd287 service placement] SCRIPT_NAME: `/identity` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:50:07.642057 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb35131-578d-4795-9a5f-c72fe93fd287 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86100) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:50:07.643825 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.fernet_utils [None req-dbb35131-578d-4795-9a5f-c72fe93fd287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86100) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:50:07.655257 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb35131-578d-4795-9a5f-c72fe93fd287 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:50:07.656843 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb35131-578d-4795-9a5f-c72fe93fd287 service placement] RBAC: Authorization granted {{(pid=86100) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:50:07.666890 dv-cinder-836252-3-iscsi devstack@keystone.service[86100]: [pid: 86100|app: 0|req: 1467/2905] 10.222.0.32 () {60 vars in 1365 bytes} [Tue Apr 12 00:50:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)